-- Logs begin at Sat 2022-08-27 01:35:59 UTC, end at Sat 2022-08-27 02:34:44 UTC. -- Aug 27 02:06:08.065433 dv-cinder-846303-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 27 02:06:08.077743 dv-cinder-846303-3-smb devstack@keystone.service[81732]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 27 02:06:08 2022] *** Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: nodename: dv-cinder-846303-3-smb Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: machine: x86_64 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: clock source: unix Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: pcre jit disabled Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: detected number of CPU cores: 4 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: current working directory: / Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: detected binary path: /usr/bin/uwsgi-core Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: your processes number limit is 47680 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: your memory page size is 4096 bytes Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: detected max file descriptor number: 2048 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: lock engine: pthread robust mutexes Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: thunder lock: enabled Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 27 02:06:08.081451 dv-cinder-846303-3-smb devstack@keystone.service[81732]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 27 02:06:08.119172 dv-cinder-846303-3-smb devstack@keystone.service[81732]: Python main interpreter initialized at 0x562f31d9a9c0 Aug 27 02:06:08.119172 dv-cinder-846303-3-smb devstack@keystone.service[81732]: python threads support enabled Aug 27 02:06:08.119172 dv-cinder-846303-3-smb devstack@keystone.service[81732]: your server socket listen backlog is limited to 100 connections Aug 27 02:06:08.119172 dv-cinder-846303-3-smb devstack@keystone.service[81732]: your mercy for graceful operations on workers is 90 seconds Aug 27 02:06:08.119599 dv-cinder-846303-3-smb devstack@keystone.service[81732]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 02:06:08.119599 dv-cinder-846303-3-smb devstack@keystone.service[81732]: *** Operational MODE: preforking *** Aug 27 02:06:08.119888 dv-cinder-846303-3-smb devstack@keystone.service[81732]: *** uWSGI is running in multiple interpreter mode *** Aug 27 02:06:08.119888 dv-cinder-846303-3-smb devstack@keystone.service[81732]: spawned uWSGI master process (pid: 81732) Aug 27 02:06:08.120078 dv-cinder-846303-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 27 02:06:08.121432 dv-cinder-846303-3-smb devstack@keystone.service[81732]: spawned uWSGI worker 1 (pid: 81747, cores: 1) Aug 27 02:06:08.121432 dv-cinder-846303-3-smb devstack@keystone.service[81732]: spawned uWSGI worker 2 (pid: 81748, cores: 1) Aug 27 02:06:08.121432 dv-cinder-846303-3-smb devstack@keystone.service[81732]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 02:06:12.547161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:06:12.547161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: from cryptography.utils import int_from_bytes Aug 27 02:06:12.547989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:06:12.547989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: from cryptography.utils import int_from_bytes Aug 27 02:06:12.596942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:06:12.597168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:06:12.597317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] command line args: [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:06:12.597614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:06:12.597794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ================================================================================ {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:06:12.598045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] admin_token = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.598290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] config_dir = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.598480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.598660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] config_source = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.598836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] debug = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.599034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.599408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.599586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.599834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.600082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.600310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.600484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_config_append = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.600662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.600832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_dir = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.601006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_file = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.601241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.601536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.601816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.602070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.602223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.602395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.602707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.602953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.603199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.603415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.603645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.603877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.604123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.604381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.604655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.605151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.605327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] publish_errors = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.605616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.605846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.606025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.606268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.606496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.606727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] standard_threads = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.606958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.607195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.607371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.607541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] use_journal = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.607713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] use_json = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.607884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] use_stderr = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.608056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] use_syslog = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.608284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.608547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.608777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.609033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.609271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.609542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.609779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.610023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.610263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.610504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.610745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.610995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.611227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.611470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.611705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.611947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.612190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.612423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.612677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.612925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.613169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.613421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.613671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.613937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.614188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.614431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.614661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.614891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.615117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.615352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.615596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.615847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.616073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.616298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.616542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.616784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.617018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.617264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.617515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.617761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.617994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.618221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.618456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.618686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.618910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.619144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.619389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.619618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.619850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.620104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.620353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.620650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.621071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.621407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.621637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.621876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.622115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.622352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.622588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.622818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.623001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:06:12.623001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: from cryptography.utils import int_from_bytes Aug 27 02:06:12.623567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.623567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.623752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 02:06:12.623752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: from cryptography.utils import int_from_bytes Aug 27 02:06:12.623888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.623888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.624097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.624191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.624406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.624643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.625760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.625760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.625760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.625760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.626070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.626070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.626294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.626531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.626776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.627009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.627244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.627485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.627719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.627963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.628201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.628440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.628674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.628917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.629147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.629424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.629668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.629912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.630146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.630382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.630622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.630852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.631086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.631324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.631547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.631776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.632002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.632233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.632460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.632697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.632929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.633172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.633418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.633680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.633933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.634170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.634399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.external = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.634627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.634918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.635148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.635374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.password = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.635605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] auth.token = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.635838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.636070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.636313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.636541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.636785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.637057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.637286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.637560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.637804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.638049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.638292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.638549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.638791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.639022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.639277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.639531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.639762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.640013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.640305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.640549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.640810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.641051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.641307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.641569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.641808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.642054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.642301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.642531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.642776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.643009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.643261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.643495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.643746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.643983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.644233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.644465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.644706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.644953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.645186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.645443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.645816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.646051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.646289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.646541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.646792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.647022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.647248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.647476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.647722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.647970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.648215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.648478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.648721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.648993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.649229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.649495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.649742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.650021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.650260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.650740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.650966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.651523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.651776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.652008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.652256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.652554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.652796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.653044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.653290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.653546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.653786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.654014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.654249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.654484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.654726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.654961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.655194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.655441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.655688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.655914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.656141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.656386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.656630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.656864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.657096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.657330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.657600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.657837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.658092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.658324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.658568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.658811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.659065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.659307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.659536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.659769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.660002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.660235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.660463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.660707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.660950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.661196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.661457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.661701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.662002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.662255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.662492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.662725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.662958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.663190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.663431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.663676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.663913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.664166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.664396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.664638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.664871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.665103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.665337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.665622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.665872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.666103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.666337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.666578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.666823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.667068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.667300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.667545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.667791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.668025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.668298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.668538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.668774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.669009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] role.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.669253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] role.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.669504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.669751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.669995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.670239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.670482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.670724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.670965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.671207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.671450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.671680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.671924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.672167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.672411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.672654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.673082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.673314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.673598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.673846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.674092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.674340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.674572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.674832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.675082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.675319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.675479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 02:06:12.675568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.675707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 02:06:12.675794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.675921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] command line args: [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 02:06:12.676051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.676187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 02:06:12.676302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.676410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ================================================================================ {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 02:06:12.676530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.676640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] admin_token = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.676746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.676861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] config_dir = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.676976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.677098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.677218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.677297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] config_source = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.677369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] debug = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.677486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.677576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.677691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.677832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.678044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.678143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.678223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.678317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.678471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.678721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.678953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.679150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_config_append = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.680105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.680337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.680337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_dir = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.681499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_file = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.681696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.681969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.682932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.682992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.683057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.683125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.683125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.683230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.683289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.connection = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.683515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.683798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.61/identity {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.683923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.684029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] publish_errors = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.684213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.684290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.684360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.684477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.684554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.684713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.684807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.684949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.685031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.685183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.685265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.685435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] standard_threads = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.685538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.685670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.685759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.685913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.685996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.686068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.686147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.686244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] use_journal = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.686374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.686461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] use_json = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.686614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] use_stderr = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.686737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.686832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] use_syslog = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.686908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.686981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 02:06:12.687053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687368 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:06:12.687807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.687887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.688158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.688393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.688635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.688901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.689225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.689547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.689875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.690163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.690414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.690651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.690895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.691142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.691382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.691792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.692073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.692324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.692579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.692936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.693198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.693476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.693754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.694080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.694344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.694630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.694937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.695190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.695439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.695668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.696096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.696513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.696974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.697421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.697692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.697934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.698175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.698427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.698660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.698894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.699127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.699414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.699681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.699981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.700268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.700562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.700838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.701127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.701367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.701641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.701907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.702147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.702384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.702620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.702839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.703079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.703308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.703556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.703790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.704023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.704254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.704518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.704782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.705064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.705372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.705712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.706053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.706299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.706550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.706797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.707033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.707268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.707503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.707747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.707980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.708217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.708458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.708695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.708938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.709174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.709491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.709808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.710044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.710281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.710544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.710887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.711158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.711446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.711796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.712079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.712319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.712558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.712825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.713062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.713293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.713548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.713788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.714016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.714263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.714498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.714746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.715014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.715335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.715595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.715835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.716067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.external = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.716296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.716591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.716821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.717162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.password = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.717370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] auth.token = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.717819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.718121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.718449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.718716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.718987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.719248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.719570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.719866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.720149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.720391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.720839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.720960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.721291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.721595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.721914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.722201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.722426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.722821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.723338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.723443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.723638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.723882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.724257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.724381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.724619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.724881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.725102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.725331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.725768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.726028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.726258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.726500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.726758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.726987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.727234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.727469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.727713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.727957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.728194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.728428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.728672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.728904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.729138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.729388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.729654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.729886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.730143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.730419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.730791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.731125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.731435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.731718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.731966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.732239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.732478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.732712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.732815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.732923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.733053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.733217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.733385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.733585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.733723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.733872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.734109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.734341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.734572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.734816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.735060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.735293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.735539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.735831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.736137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.736434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.736712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.736991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.737241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.737506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.737742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.738134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.738383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.738630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.738863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.739092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.739341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.739618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.739948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.740205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.740496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.740808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.741049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.741339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.741583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.741831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.742078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.742324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.742556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.742785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.743018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.743256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.743488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.743721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.743965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.744208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.744451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.744693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.744864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.744992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.745214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.745543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.745845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.746152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.746423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.746689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.746936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.747184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.747421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.747675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.747902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.748146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.748379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.748612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.748845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.749088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.749326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.749576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.749810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.750050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.750296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.750542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.750773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.751016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.751266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.751495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.751736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.751970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.752206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.752439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] role.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.752685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] role.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.752977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.753235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.753589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.753906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.754221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.754470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.754744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.754987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.755380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.755624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.755866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.756112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.756361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.756603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.757094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.757339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.757680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.758015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.758301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.758554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.758790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.759046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.759298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.759540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.759805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.760034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.760262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.760509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.760764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.761009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.761246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.761501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.761730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.762162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.762399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.762652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.762882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.763137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.763381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.763617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.763859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.764101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.764343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.764580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.764846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.765163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.765498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.765867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.766158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.766450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.766720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.767069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.connection = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.767332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.767629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.767871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.768133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.768368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.768602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.768834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.769067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.769309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.769566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.769807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.770039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.770284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.770515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.770758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.770982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.771218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.771451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 02:06:12.771618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 02:06:12.778189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.778421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.798836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.799120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.799252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.808010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.827724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.827928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.831728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.869184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.882903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.883152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.907317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.907527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.949161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.949430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.949561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.949805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.950013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.950348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.977076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.977282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.977547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.977774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.977996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.978208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.978423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:12.990562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.047557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.047897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.048171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.048388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.048607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.048891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.063489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.063705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.063917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.064135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.064349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.064558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.064749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.074910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.089262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.089497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.089717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.089912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.090214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.090425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.090637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81748) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.094898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.095137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.095364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.095568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.095776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.095998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.096214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81747) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 27 02:06:13.109286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.109484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 02:06:13.109604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.109835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 02:06:13.109957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 02:06:13.110135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 27 02:06:13.110561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.110976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.111088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.111175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.111478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.120747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.120981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.121276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.121614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.121836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.122115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.122383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.122662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.128551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.130320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.131479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.131766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.132048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.132328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.132594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.132858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.133135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.133289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.133443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.133715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.133834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.134144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.134269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.134452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.134672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.134974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.135238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.135527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.135857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.136131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.136387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.136653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.157437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.158906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.159194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.161158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.162835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.163120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.163718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.164008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.164433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.168043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.168363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.168644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.170834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.171126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.175105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.175411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.175610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.175700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.175928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.176055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.176357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.176623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.176902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.177180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.180353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.180640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.180933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.181220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.181524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.181952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.182237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.182512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.192504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.192785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.196824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.199915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.200330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.200605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.200889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.204471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.205270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.207554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.208663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.208958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.210608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.210908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.211195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.211592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.211863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.212266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.213780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.216899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.220324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.220618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.220898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.221182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.221480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.221860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.228136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.228428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.228701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.228978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.235712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.238210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.238500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.238685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.238770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.239009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.240224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.240487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.243216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.243508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.243794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.244077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.244366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.246601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.248395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.249931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.250214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.252908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.253263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.253635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.254028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.254304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.255663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.255951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.256237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.256521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.256808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.257096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.257375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.266233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.266525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.266802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.267080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.267359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.267630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.267910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.273064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.276090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.279306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.281045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.282233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.282524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.282812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.284520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.287840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.289188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.290690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.290816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.292449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.293622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.293935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.294112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.294200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.294394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.294480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.294674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.301522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.302359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.302657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.302942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.303179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.306165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.306587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.306711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.307001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.309888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81747) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.310181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.310466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.311253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.311253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.311253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.311552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.311848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.312106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.312369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.312644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.312908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.313185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.313479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81747) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.315646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.315944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.316219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.323504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81748) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 27 02:06:13.323787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.324063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.324351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.324625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.324901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.325180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.325477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.325742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.326007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.326268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.326537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.326814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.327095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81748) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 27 02:06:13.346140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f31d9a9c0 pid: 81747 (default app) Aug 27 02:06:13.349770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118613d3-6ab9-4058-a3e8-61ed85249567 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:13.350059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118613d3-6ab9-4058-a3e8-61ed85249567 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:13.350344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118613d3-6ab9-4058-a3e8-61ed85249567 None None] PATH_INFO: `/v3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:13.354553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 791 bytes} [Sat Aug 27 02:06:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:13.363635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562f31d9a9c0 pid: 81748 (default app) Aug 27 02:06:19.909455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:19.909971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:19.910121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:19.911525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:19.920257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:19.920780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:19.920780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:19.989482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: INFO dbcounter [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] Registered counter for database keystone Aug 27 02:06:20.009280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG oslo_db.sqlalchemy.engines [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:06:20.016088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writer thread running {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:06:20.194601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG passlib.handlers.bcrypt [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81748) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 02:06:20.194898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG passlib.handlers.bcrypt [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81748) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 02:06:20.250226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:20.251853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:20.406188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1/3] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 27 02:06:20.876890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:20.949274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: INFO dbcounter [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] Registered counter for database keystone Aug 27 02:06:20.971006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG oslo_db.sqlalchemy.engines [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 02:06:20.978576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writer thread running {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 27 02:06:21.110486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43d22e-2641-4074-951a-d035c18df8a5 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:21.115618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:21.116344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:21.116623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:21.116956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:21.126806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:21.181833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 02:06:21.182101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21df30-5a4c-4921-b0ee-1055beb2cc16 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:21.192529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1324 bytes} [Sat Aug 27 02:06:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:06:21.198680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:21.215088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934398e5-cbe4-4102-b2dd-713a59378498 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:21.221005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:21.222173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:21.222450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:21.222719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] PATH_INFO: `/v3/projects/6316912820d4459d94f37567f9470b42` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:21.224443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] RBAC: Authorizing `identity:get_project(project_id=6316912820d4459d94f37567f9470b42)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:21.282688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 27 02:06:21.283132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9512dbf3-9ec2-4fed-9d4d-f2cd09ed9f28 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:21.287838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 2/5] 10.222.0.61 () {56 vars in 1207 bytes} [Sat Aug 27 02:06:21 2022] GET /identity/v3/projects/6316912820d4459d94f37567f9470b42 => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:23.265254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7995ad-715f-434e-b814-1d34b7f0cbc1 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:23.265953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7995ad-715f-434e-b814-1d34b7f0cbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:23.265953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7995ad-715f-434e-b814-1d34b7f0cbc1 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:23.270239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 4/6] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:23.276486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28577-6025-49f8-b581-d309f1522595 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:23.276936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28577-6025-49f8-b581-d309f1522595 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:23.277029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28577-6025-49f8-b581-d309f1522595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:23.299259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-adc28577-6025-49f8-b581-d309f1522595 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:23.300837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-adc28577-6025-49f8-b581-d309f1522595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:23.315636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 27 02:06:23.613053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7995ad-715f-434e-b814-1d34b7f0cbc1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:23.625971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7995ad-715f-434e-b814-1d34b7f0cbc1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:23.630737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:23.631370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:23.631649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:23.631917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:23.641582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:23.643375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84201305-e2b1-4dda-a850-55a414b170a2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:23.654728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1324 bytes} [Sat Aug 27 02:06:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:06:23.660660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28577-6025-49f8-b581-d309f1522595 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:23.672532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc28577-6025-49f8-b581-d309f1522595 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:23.678276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:23.678929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:23.679212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:23.679488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:23.680975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:23.682888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3297258-35e4-4a19-b96b-53611d817c29 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:23.684573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 4/9] 10.222.0.61 () {56 vars in 1198 bytes} [Sat Aug 27 02:06:23 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:25.690695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dd774-24ab-4d4e-af85-fee0e8070907 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:25.691253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dd774-24ab-4d4e-af85-fee0e8070907 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:25.691253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dd774-24ab-4d4e-af85-fee0e8070907 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:25.692793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:25.693346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20c02-6ac9-4703-9d69-855065ba23ef None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:25.693767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20c02-6ac9-4703-9d69-855065ba23ef None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:25.693956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20c02-6ac9-4703-9d69-855065ba23ef None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:25.695367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 5/11] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:25.698214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:25.698503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:25.698781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:25.701844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:25.702131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:25.702407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:25.720137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:25.721337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:25.743038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG passlib.handlers.bcrypt [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81747) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 27 02:06:25.743481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG passlib.handlers.bcrypt [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81747) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 27 02:06:25.788885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:25.790571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:25.805526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:25.894370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:26.067082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.090386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.157938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.181963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac5516-2668-449e-b4d4-0ebd1c6da7f6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.216459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.217093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.217367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.217668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.228931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:26.237560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:26.238891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:26.239946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 7/14] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:26.244501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.268125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9565e-ec64-49e0-9882-e1d2897624b9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.270907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.309075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.310169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.310662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.311701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.337154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.356262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190981a9-8741-4df4-8c71-b3e087c733d0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.388175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.389777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.392568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.393187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.393575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.393846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.394521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:26.394826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.396215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.408982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 8/15] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:26.414634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.500189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 8/16] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 02:06:26.506684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.509974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.518632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b1ae5-c353-4a47-a866-16e0f6750832 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.556334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.557034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.557315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.557644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.558859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.560500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.562233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 9/17] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:26.568015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.583805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.617507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e7d5d-e743-4bec-8627-7b665a633adc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.652047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.652958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.653227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.653530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.672407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.673932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.679773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f605d1-a7e7-4727-952e-d0df725b7ca0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:06:26.692753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:26.694149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:06:26.695117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:06:26.695117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:06:26.695117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:26.695117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 9/18] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:06:26.699999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.716350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.717026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.717282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.717612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.718754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.720221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.721796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 10/19] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:26.728147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:26.770732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.812110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:26.821304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf18407-abb5-4478-87c0-54f6d29fbe37 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.835232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15504db7-ac46-4297-b9f7-b10064ddc22f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:26.858508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.859256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.859616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.859933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.860639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:26.860990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.862577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258da95-1e35-4fd5-a815-3d454b43ce23 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.880117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:26.880735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:26.881036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:26.881317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:26.881915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 10/20] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:26.882176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.domain.id=default, user.id=b214a184834a4cb0b49321b412607103) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:26.882526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:26.884169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204d717-5f0f-494c-b452-bdc3e00c6019 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:26.892568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 11/21] 10.222.0.61 () {56 vars in 1322 bytes} [Sat Aug 27 02:06:26 2022] GET /identity/v3/role_assignments?user.id=b214a184834a4cb0b49321b412607103&scope.domain.id=default&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:29.071221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078cf03-6062-4194-9fa0-280cd85cb38c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.071766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078cf03-6062-4194-9fa0-280cd85cb38c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.071766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078cf03-6062-4194-9fa0-280cd85cb38c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.073715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4eb00-951e-4194-8f79-4c09fdb064db None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.074179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4eb00-951e-4194-8f79-4c09fdb064db None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.074274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4eb00-951e-4194-8f79-4c09fdb064db None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.076749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 11/22] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:29.076983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 12/23] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:29.080909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.081200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.081497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.084530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db06f17-aebf-4ea1-8627-9dfd3f5d4d45 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.084809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db06f17-aebf-4ea1-8627-9dfd3f5d4d45 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.085082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db06f17-aebf-4ea1-8627-9dfd3f5d4d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.111156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0db06f17-aebf-4ea1-8627-9dfd3f5d4d45 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:29.112364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0db06f17-aebf-4ea1-8627-9dfd3f5d4d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:29.118518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:29.119703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:29.207181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 13/24] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:29.208459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c73be-db93-4b2f-8a0f-b990c28b2a20 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.208985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c73be-db93-4b2f-8a0f-b990c28b2a20 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.209287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c73be-db93-4b2f-8a0f-b990c28b2a20 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.210595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 14/25] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:29.216144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.216536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.216984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.226762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 12/26] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:29.240402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:29.249717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:29.323416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 15/27] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:29.605359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:29.663861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:29.715479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:29.719378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:29.726282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b262c0-31f3-4257-8ea0-808e2c7f74cf None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:29.768290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:29.768951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.769237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.769530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.790950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:29.803669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:29.804871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:29.805680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 13/28] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:29.818514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:29.899073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a5f70-68c1-4415-8413-e6bd471f1f3a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:29.942993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:29.943903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:29.944328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:29.944741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:29.945846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:29.948129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0fe14-1f42-45f6-9f61-6c4a345fd760 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.004352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5df2e-cdfe-49d9-93b2-21c1efb6af4b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.016638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:30.058174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.059088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.059515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.059940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.061025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:30.061547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.063850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.083513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 14/29] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:30.084679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.108563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 16/30] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Aug 27 02:06:29 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:30.115067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc7f9-75fc-477d-869a-1f407b202e6b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.116252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc7f9-75fc-477d-869a-1f407b202e6b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.116752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dc7f9-75fc-477d-869a-1f407b202e6b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.118402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 17/31] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:30.118960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc7f9-75fc-477d-869a-1f407b202e6b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.251404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:30.274733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ae51a-f8f7-4a29-b79b-ca608bbdc8d5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.300637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dc7f9-75fc-477d-869a-1f407b202e6b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.311193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.312042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.312474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.312895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.324672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.326388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.345987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.347209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.348001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.348795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0fcbb218-8925-4f21-bbcc-9f29e40e4aca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:06:30.350246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:30.351275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:06:30.352264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:06:30.352264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:06:30.352264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:30.352458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.353727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.353895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 15/32] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:30.359614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.360083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.360489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.361536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 18/33] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:30 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:30.362427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.385457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:30.387030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:30.403194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:30.465536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 16/34] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:30.466491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.474145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3b283-f85b-4a55-b3a2-2216bd4f3b89 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.505896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:30.515003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.516093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.516554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.517004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.517881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:30.518485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.520251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.542130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 19/35] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:30.547759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.635569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd735c20-226b-4353-bfc4-98d9722ec221 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.659322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d7177-c20b-4b96-916f-ee8e7fe667ae None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.696860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.698043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.698667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.699206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.700108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.701807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.706098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.706753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.707034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.707304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.714707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.715878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.717522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 17/36] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:30.729533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:30.738033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 20/37] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:06:30 2022] POST /identity/v3/projects => generated 301 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:30.768872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:30.853370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6b138-b5a0-444b-a851-4115ccf43772 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:30.890652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:30.891465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:30.891746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:30.892015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] PATH_INFO: `/v3/domains/default/users/b214a184834a4cb0b49321b412607103/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:30.894234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b214a184834a4cb0b49321b412607103, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:30.895867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d082bb3-e57d-478a-bbb6-87c1d692893b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:30.933148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:31.004303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:31.025366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 18/38] 10.222.0.61 () {58 vars in 1361 bytes} [Sat Aug 27 02:06:30 2022] PUT /identity/v3/domains/default/users/b214a184834a4cb0b49321b412607103/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:06:31.059782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095898-7454-4982-b803-1d72c5d2a23f None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.060693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095898-7454-4982-b803-1d72c5d2a23f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.061199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4095898-7454-4982-b803-1d72c5d2a23f None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.067412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 19/39] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:31.073384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6ee7-4150-43cb-8ed2-e511c95fc5ba None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.073765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6ee7-4150-43cb-8ed2-e511c95fc5ba None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.074110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b6ee7-4150-43cb-8ed2-e511c95fc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.103454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-755b6ee7-4150-43cb-8ed2-e511c95fc5ba None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:31.105131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-755b6ee7-4150-43cb-8ed2-e511c95fc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:31.133512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc29f-894c-4dac-b977-29235d343241 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:31.176783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:31.177884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.178449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.178903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.180029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:31.181821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514885-3f22-4d2f-8945-5726099f6821 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:31.200538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Aug 27 02:06:30 2022] POST /identity/v3/roles => generated 225 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:31.244619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 20/41] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:31.275242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558990c-c61d-41d8-a0a4-c2977cc1f505 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.275814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558990c-c61d-41d8-a0a4-c2977cc1f505 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.276547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558990c-c61d-41d8-a0a4-c2977cc1f505 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.278171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 22/42] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:31.287625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.288262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.288737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.308846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:31.310103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:31.327428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:31.388040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 21/43] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:31.563288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558990c-c61d-41d8-a0a4-c2977cc1f505 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:31.650344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:31.669874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558990c-c61d-41d8-a0a4-c2977cc1f505 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:31.672310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:31.709486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:31.710114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.710441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.710709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.711337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:31.712870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:31.729233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Aug 27 02:06:31 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:31.769270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7063eb49-db4c-4027-9bf2-78d324244ab4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:31.807973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:31.808673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.808957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.809234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.810481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:31.812134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9168a3a-8d2f-450d-af56-2214844ac2c7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:31.814041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 22/45] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:31.819534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:31.931852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d541710-a44e-402f-8d7b-b013dbcac19a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:31.967184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:31.967831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:31.968115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:31.968393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:31.969062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:31.970566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9f175-ad72-4d87-9159-df9248a075e8 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:32.108384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:06:31 2022] POST /identity/v3/projects => generated 312 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:33.000543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790c88-a39e-4291-8512-f1ddf6f746ed None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:33.001362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790c88-a39e-4291-8512-f1ddf6f746ed None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:33.001569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db790c88-a39e-4291-8512-f1ddf6f746ed None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:33.002940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 23/47] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:33.008623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:33.009059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:33.009280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:33.031700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:33.033340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:33.045833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:33.106514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 25/48] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:33.575381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790c88-a39e-4291-8512-f1ddf6f746ed None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:33.589006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:33.727048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db790c88-a39e-4291-8512-f1ddf6f746ed None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:33.775661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:33.776917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:33.777338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:33.777798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:33.792717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:33.801509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:33.802430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:33.803165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 24/49] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:33.811318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:33.915578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c940f5-a6f6-4a69-8ce1-3993b009991c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:33.950692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:33.951299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:33.951576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:33.951847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:33.952525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:33.952824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:33.954244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c81ac3-9192-4adc-a127-a3974e411d13 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:33.968805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 26/50] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:33.970159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:33.999272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c6e3-d5e5-480f-8082-22d4abf1c133 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:33.999821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c6e3-d5e5-480f-8082-22d4abf1c133 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.000236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c6e3-d5e5-480f-8082-22d4abf1c133 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.001778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 27/51] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:34.007210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.007595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.007988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.027311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:34.028514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:34.030757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:34.039200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:34.078908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cd09a-a9fc-4ffa-84c8-1ff8b4ec9824 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:34.101600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 28/52] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:34.126704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:34.127642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.128066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.128487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.130189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:34.132519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:34.135008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 25/53] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:33 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:34.141025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:34.284291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e4cbc-59b2-4897-91e5-c84803591b98 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:34.329457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:34.330125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.330408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.330678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.331829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:34.333411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:34.335076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 29/54] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:34.341126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:34.366681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:34.377061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:34.449904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4abd0f-b842-4509-b422-f6defda84dac None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:34.473608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed2ae-4acc-4822-8b35-381dcd319a0a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:34.485372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:34.486018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.486296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.486550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.487275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.domain.id=default, user.id=b214a184834a4cb0b49321b412607103) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:34.487601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:34.489070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:34.494350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:34.498350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 26/55] 10.222.0.61 () {56 vars in 1322 bytes} [Sat Aug 27 02:06:34 2022] GET /identity/v3/role_assignments?user.id=b214a184834a4cb0b49321b412607103&scope.domain.id=default&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:34.509107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:34.509795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.510071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.510339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.511639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:34.513325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea52f36a-45e5-4adb-b2b4-2f8408308438 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:34.515253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 30/56] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:34.520968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:34.633995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c926b-9fd1-4f58-8f1d-21243cd9c552 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:34.678127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:34.679061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:34.679437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:34.679776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:34.680853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:34.682524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68a9cb-8942-4ab1-8e1f-8889a67a7e69 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:34.716105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 27/57] 10.222.0.61 () {60 vars in 1140 bytes} [Sat Aug 27 02:06:34 2022] POST /identity/v3/projects => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:36.644974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8fd5-e3c6-4084-b3cd-752ce9369edd None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:36.645583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8fd5-e3c6-4084-b3cd-752ce9369edd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:36.645583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8fd5-e3c6-4084-b3cd-752ce9369edd None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:36.646892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 31/58] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:36.652686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:36.653125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:36.653212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:36.673498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:36.674703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:36.723885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:36.746343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 28/59] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:37.011718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8fd5-e3c6-4084-b3cd-752ce9369edd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:37.089561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:37.116421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8fd5-e3c6-4084-b3cd-752ce9369edd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:37.149953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:37.150591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:37.150877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:37.151441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:37.152637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:37.154152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52b47c-860b-432d-807d-1112201aa0ae None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:37.155759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 32/60] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:37.161766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:37.259339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc236a02-1cdc-447a-84f0-8f4ec3f9f96f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:37.298975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:37.299485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:37.299761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:37.300005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:37.300689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:37.302178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aced6-52a9-432e-8ec9-3a99cea1115b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:37.343904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 29/61] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:06:37 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:40.922656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6234a-af1d-48ad-a95f-18c33726af7c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:40.922656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6234a-af1d-48ad-a95f-18c33726af7c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:40.922656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6234a-af1d-48ad-a95f-18c33726af7c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:40.922656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 33/62] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:40.930277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9015-5f89-425d-9cb7-fa0e6e01f7de None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:40.931197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9015-5f89-425d-9cb7-fa0e6e01f7de None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:40.931676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b9015-5f89-425d-9cb7-fa0e6e01f7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:40.949607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ad98-6fba-4636-8d26-c7a374d3cd3b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:40.950248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ad98-6fba-4636-8d26-c7a374d3cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:40.950719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018ad98-6fba-4636-8d26-c7a374d3cd3b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:40.952263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 34/63] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:40.959281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838d75-8a85-46f0-85d3-ebe9eecde072 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:40.959894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838d75-8a85-46f0-85d3-ebe9eecde072 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:40.960377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea838d75-8a85-46f0-85d3-ebe9eecde072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:40.965869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c31b9015-5f89-425d-9cb7-fa0e6e01f7de None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:40.968080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c31b9015-5f89-425d-9cb7-fa0e6e01f7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:40.994630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ea838d75-8a85-46f0-85d3-ebe9eecde072 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:40.998704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ea838d75-8a85-46f0-85d3-ebe9eecde072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:41.038114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:41.115084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 30/64] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:41.142001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 35/65] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:41.171528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6808-7932-4e59-8525-18d951915ee6 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.172163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6808-7932-4e59-8525-18d951915ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.172635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6808-7932-4e59-8525-18d951915ee6 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.174280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 31/66] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:41.180067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.180728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.181202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.207148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:41.208689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:41.310840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 36/67] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:41.450703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6808-7932-4e59-8525-18d951915ee6 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:41.476796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:41.481138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:41.612612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6808-7932-4e59-8525-18d951915ee6 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:41.654458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa36a5-622c-49e2-a0bd-2cc41639b915 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:41.667317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:41.668558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.669190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.669811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.686783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-7f48fbc7-1f46-4064-9cff-1beb8fbfc951 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:41.695159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:41.696513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:41.697563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 32/68] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:06:41.702091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702efa4-1c5b-4525-a208-593856a55b80 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.702091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702efa4-1c5b-4525-a208-593856a55b80 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.702091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702efa4-1c5b-4525-a208-593856a55b80 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.702527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 33/69] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:41.703550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702efa4-1c5b-4525-a208-593856a55b80 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:41.709707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:41.711308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.712032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.712475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.730328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:41.739070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:41.739952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:41.740713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:41.741300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 37/70] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:06:41.742051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:41.750522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:41.824389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:41.853054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702efa4-1c5b-4525-a208-593856a55b80 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:41.877643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b283790-5d9f-44f5-b6f8-3a876c0ae4e2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:41.904637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:41.905638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.906073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.906469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.917240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:41.918015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.918459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.918927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.919702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:41.920004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:41.921450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9545d4-b572-4f36-8868-d66102214046 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:41.922603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:41.930926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:41.932370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:41.938417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:41.939024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 38/71] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:41.939024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:41.939024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:41.939522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 34/72] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:06:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:41.939639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:41.939766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:41.966599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:41.969539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:42.055104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.069548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94fb7f-d043-4a98-9ad4-fd2e1f536bec None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.076933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 39/73] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:42.089632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.121688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.122426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.122872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.123323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.124285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:42.124728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.127058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.142695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 35/74] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:42.142695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.158213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.221794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d6e3-479f-4d81-82e9-034ae65b78f9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.266124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f27a-f3e0-4635-8d94-dbc9c34ceca0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.267186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.267819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.268097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.268362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.269042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:42.269369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.270808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccf259-b909-41cd-a41c-5de20e32ba68 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.281881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 40/75] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:42.283716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6424-f808-499c-a45b-914a5247cd68 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.284151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6424-f808-499c-a45b-914a5247cd68 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.284588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f6424-f808-499c-a45b-914a5247cd68 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.286319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 41/76] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:42.289573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6424-f808-499c-a45b-914a5247cd68 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.318323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.319907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.320383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.320865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.341974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.343507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.345228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 36/77] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:42.345228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.355395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.416994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f6424-f808-499c-a45b-914a5247cd68 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.435458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.455121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b380fc4f-3b39-472b-95da-552c28e82936 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.456151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.456786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.457065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.457371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.458560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.460002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddb9b2-04dc-438a-853e-a6b29003ac7a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.466499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 42/78] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:42.466499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.466499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.466499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.485742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:42.487224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:42.510497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.511215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.511502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.511781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.513078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.515191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.517007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 37/79] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:42.517626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.581629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 43/80] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:42.582690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:42.612243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.653610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08280664-fbb9-4e0f-a985-ee217188991c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.697835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.698875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.699409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.699770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.713283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c101fb-4ebb-4779-8c84-a3351f036b1c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:42.740861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.774801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:42.775744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:42.776743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:42.777129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:42.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.799644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.873989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:42.876513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:42.901903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:42.929635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 38/81] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:42.930548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.009763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 44/82] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:43.011015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.029288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.141258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410f434-a1f7-4358-ad1c-8634c502233a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.146727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7df6fc-3db9-4af4-b0b8-6dc02b2416f7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.183371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.184039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.184318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.184589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.186994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.187655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.187947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.188273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.195638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:43.200725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:43.205892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 45/83] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:43.206773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.239449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.267268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.268896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.289085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.315883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec6663-d8ef-4dce-93e3-1b57fa106b24 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.354509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.355296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.355571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.355850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.356982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.358502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.360376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 46/84] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.360940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.379582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 39/85] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:43.380501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.465655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.479427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985298e-48c5-4aaa-bb87-b3d688955431 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.493423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fcb71-cabc-4cd2-92de-913a3c5b84f1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.519667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.520205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.520487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.520762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.521944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.523465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.525119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 47/86] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.526230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.536070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.536990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.537445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.537863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.539775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.542107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.543473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.544892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 40/87] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.546283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.666160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005980d8-a317-4048-858f-66b724c89c62 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.673094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f943f-d18d-4478-80d5-c535e0496925 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.709298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.710262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.710854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.711218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.711989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.713483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.716771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.717387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.717702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.717970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.718650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:43.718954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.720435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.730115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 48/88] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.730854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.731460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.739047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 41/89] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:06:43 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:43.740678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.836236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:43.872280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b907a-2785-4901-804b-295bc6bf2b78 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.873631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e61a-34da-45e5-b800-e619672a3ea7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:43.914688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.915464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.915762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.916040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.917263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.918879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.920834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 49/90] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.921646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:43.932458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:43.933786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:43.934073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:43.934348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:43.935349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:43.935694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:43.938015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:43.944429 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 42/91] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=0fb732effc6f492c9a998d105764e845 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:43.945459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:44.066351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:44.112732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b57e-c1c9-4101-8358-1e4d7a0d06c7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:44.138386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809552-ac9f-4437-a53f-c3ab96bf9814 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:44.180311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:44.180918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:44.181583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:44.182061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:44.182355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:44.182522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:44.183038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:44.183573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:44.183928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=b214a184834a4cb0b49321b412607103) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:44.184480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:44.185498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:44.187172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:44.187501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:44.189435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 43/92] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:44.190503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:44.200031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 50/93] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:43 2022] GET /identity/v3/role_assignments?user.id=b214a184834a4cb0b49321b412607103&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:44.204727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:44.216213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:44.372941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139fbb6-55d3-4625-a507-ffb561c1499e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:44.429714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:44.440001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:44.441103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:44.441603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:44.442185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:44.443475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:44.444050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:44.446621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:44.456583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 44/94] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:44 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=c388505e96244703b71034784851f8f0 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:44.500249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec60f9-7ae4-49e6-86b7-8a80cef24356 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:44.587399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:44.588450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:44.588971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:44.589513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:44.703493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:44.705331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:44.715138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:44.841226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 51/95] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:44.850231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:45.099746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d6ed8-f1fe-4fdd-916c-c17967db5147 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:45.151557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:45.152224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:45.152512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:45.152794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] PATH_INFO: `/v3/projects/7edaf1e793644339acdc3f3c8e1810f2` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:45.158167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] RBAC: Authorizing `identity:get_project(project_id=7edaf1e793644339acdc3f3c8e1810f2)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:45.159673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03135d37-468a-4750-b2e4-f5684b8d7648 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:45.161520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 45/96] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:44 2022] GET /identity/v3/projects/7edaf1e793644339acdc3f3c8e1810f2 => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:45.170446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:45.358222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7b8df-db9d-4770-b8a5-9f1f4efb7448 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:45.366798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:45.410766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:45.411878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:45.412357 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:45.412828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:45.413800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=7edaf1e793644339acdc3f3c8e1810f2, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:45.414404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:45.416058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219414ee-16ad-4437-b8a9-492eea12c665 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:45.426869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 52/97] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:45 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=7edaf1e793644339acdc3f3c8e1810f2&role.id=0fb732effc6f492c9a998d105764e845 => generated 259 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:47.604384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac6e2-951f-4680-9d10-07f0ac5466a7 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.605986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac6e2-951f-4680-9d10-07f0ac5466a7 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.606757 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ac6e2-951f-4680-9d10-07f0ac5466a7 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.609798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 46/98] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:47.614995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026992d-9c1d-4601-b582-9b6769158383 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.615673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026992d-9c1d-4601-b582-9b6769158383 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.615673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026992d-9c1d-4601-b582-9b6769158383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.642601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-1026992d-9c1d-4601-b582-9b6769158383 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:47.643847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1026992d-9c1d-4601-b582-9b6769158383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:47.664913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dc34-08cf-4754-b368-e77788efa673 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.665301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dc34-08cf-4754-b368-e77788efa673 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.665558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7dc34-08cf-4754-b368-e77788efa673 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.667131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 47/99] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:47.672935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed927d6-ec36-4201-adc2-b80a861545f2 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.673554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed927d6-ec36-4201-adc2-b80a861545f2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.674042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed927d6-ec36-4201-adc2-b80a861545f2 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.675889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 48/100] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:47.679601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94afbef-03a7-438c-a71d-7a6ea73672de None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.680163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94afbef-03a7-438c-a71d-7a6ea73672de None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.680668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94afbef-03a7-438c-a71d-7a6ea73672de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.714506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a94afbef-03a7-438c-a71d-7a6ea73672de None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:47.716040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a94afbef-03a7-438c-a71d-7a6ea73672de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:47.729459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 53/101] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:47.734646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55339e83-eb3d-4e37-ae0f-e2b967ea2d56 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.735395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55339e83-eb3d-4e37-ae0f-e2b967ea2d56 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.735568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55339e83-eb3d-4e37-ae0f-e2b967ea2d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.765079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-55339e83-eb3d-4e37-ae0f-e2b967ea2d56 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:47.769418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-55339e83-eb3d-4e37-ae0f-e2b967ea2d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:47.870703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:47.897007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 54/102] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:47.898373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8aacb-0cdc-44f6-b1c6-46b5e84b8230 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.898666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8aacb-0cdc-44f6-b1c6-46b5e84b8230 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.898944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8aacb-0cdc-44f6-b1c6-46b5e84b8230 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.900351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 55/103] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:47.900650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 49/104] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:47.926796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.927135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.927352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.930651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe37c-624a-4215-b632-8e62eae26323 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.931162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe37c-624a-4215-b632-8e62eae26323 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.931628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffe37c-624a-4215-b632-8e62eae26323 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.933595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 50/105] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:47.939063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:47.939598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:47.940076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:47.946391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:47.947697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:47.967479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:47.968936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:47.975769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:48.038474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 56/106] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:48.046106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 51/107] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:48.290076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.292392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.470275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0fc5-2950-46d2-b8ca-007cc926dc9b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.479969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be8705-061c-4c9f-9e71-d6f9b6a685b1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.507719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:48.519677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.520412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.520571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.520795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.526695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.527685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.528189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.528590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.532639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:48.538215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:48.539110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 57/108] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:48.546994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.549178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:48.554763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:48.555616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:06:48.556392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:48.562088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 52/109] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:06:48.562088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.572568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:48.689635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51730342-3f5f-4148-aab2-3aac5f00ecdf None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.706869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20d7a3-bf86-4655-9a1e-708faea2c3a1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.733024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.735219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.735689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.736147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.746136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.746789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.747065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.747325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.750748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:48.758608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:48.760521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 58/110] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:48.762451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.766461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:48.771741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:48.772673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 53/111] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:48.774073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.833301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:48.861684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:48.885201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e0916-6691-4fb0-861b-ff67bd5459ad None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.920085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdc80b-093f-421c-8390-7a5a36b755c3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:48.930160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.930796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.931074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.931349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.932466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:48.934322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:48.937537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 59/112] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:48.937537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:48.969822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:48.970449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:48.970734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:48.971012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:48.971724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:48.972034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:48.973462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:48.982061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 54/113] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:48.982891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.061381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13f116-befd-4605-a584-f17cf04a4f61 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.098340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.098863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.099124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91973e81-f16b-457e-b002-73f41dbb7ba7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.099217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.099425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.100072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:49.100375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.101838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.101946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.110767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 60/114] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.111601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.125568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.139880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.140603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.140973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.141416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.142359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:49.142556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.143910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.152596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 55/115] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:06:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.158219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.221746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e4462e-3c67-466a-a789-98158df01085 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.272339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.273242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.273715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.274056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.275153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:49.275656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.278446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037a016-205f-4cd2-995b-c34e57fdc6e1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.278551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569b4ff-3d01-456c-bcfb-6f1ecfad5fa2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.288953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 61/116] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.290330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982393b-2fd1-4a34-b804-025224797d87 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.290612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982393b-2fd1-4a34-b804-025224797d87 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.290887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982393b-2fd1-4a34-b804-025224797d87 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.292128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 62/117] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:49.293964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982393b-2fd1-4a34-b804-025224797d87 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.326443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.327108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.327403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.327675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.328369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.329932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.371046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 56/118] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:06:49 2022] POST /identity/v3/projects => generated 302 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:49.371046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.393757 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.402394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.457203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982393b-2fd1-4a34-b804-025224797d87 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.510444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.511559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.512000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.512273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.513631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.515128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.516769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 63/119] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.517583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.531356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535fc7-3081-463e-af51-9bfa22914313 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.581110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.582132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.582578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.583026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] PATH_INFO: `/v3/users/04c768af1dc0492aa583b1f66b10218a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.601668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] RBAC: Authorizing `identity:get_user(user_id=04c768af1dc0492aa583b1f66b10218a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.603809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.606206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 57/120] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/users/04c768af1dc0492aa583b1f66b10218a => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.607202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.659176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefb60-335c-442b-8476-7e43622cf0e2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.705893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.706890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.707349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.707801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.709561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.711010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.711749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a954c87-14e4-44e9-9374-03e1349f6b3b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.714875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 64/121] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.723446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.723858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.724319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.744458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:49.747462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e3c7-830b-4f3e-a6c1-347a9f979ccd None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:49.752460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:49.754356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:49.801887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:49.802713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:49.803183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:49.803632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:49.805448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:49.807971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:49.810721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 58/122] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:49.818631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:49.865437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 65/123] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:49.865437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.013861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7949-24ba-41f2-a369-8bcd09c54af9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.024197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba498fe9-e2e9-459b-aad4-a143e89e9d8b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.080288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.081256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.081769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.082237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.083656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.084666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.085115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.085597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.087684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.089934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.091389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.097492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 59/124] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:50.100106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.129593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.198333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.200775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.266022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc11175-bdf0-424e-9955-4468cdec1a1c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.304326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.304960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.305233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.305618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.313035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.315512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.321442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 60/125] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:50 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:50.321442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.350976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 66/126] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:50.350976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.396315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.443658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.481131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3da83-1b8c-416c-a166-54a6e60622f0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.508398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1b322-51c7-4512-af92-90daa21b89a6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.553347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.554398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.554920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.555585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.558111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.561255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.564566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.565280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 61/127] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:50 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:50.565602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.566003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.566412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/b214a184834a4cb0b49321b412607103/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.566707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.573606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, user_id=b214a184834a4cb0b49321b412607103, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.575309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.599495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 67/128] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:06:50 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/b214a184834a4cb0b49321b412607103/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:06:50.600532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.810078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67581f-3561-4074-8321-47f180ce80b1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.839284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.851900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.852553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.852839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.853116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.853279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0c799-37ac-436a-aa71-cf871c6dd8d6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:50.867405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:50.873550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:50.875213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:50.876819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 62/129] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:50.878326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:50.897294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:50.918106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:50.919320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:50.919855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:50.920389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/c388505e96244703b71034784851f8f0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:50.924176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, user_id=c26b8fa36ae14513bd7429e75abc8dbe, role_id=c388505e96244703b71034784851f8f0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:50.926990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:50.954425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 68/130] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:06:50 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/c388505e96244703b71034784851f8f0 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:06:50.956965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:51.073869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0452586-652f-4a6e-bd57-8f06aefc6ab7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:51.128701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:51.129518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.129817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.130106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.131296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:51.132800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:51.134820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 63/131] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:50 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:51.135691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:51.182496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea98dbd-0e8a-4974-b3e2-93217cae609d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:51.241936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:51.246349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:51.246537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb4c4c-e1e9-4c4f-9a6d-a91b164c41f7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:51.247715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.248199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.248860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.252527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, user_id=c26b8fa36ae14513bd7429e75abc8dbe, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:51.255157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:51.285553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 69/132] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:06:50 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:06:51.286512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:51.301201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:51.301965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.302260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.304718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.305920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:51.306245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:51.307751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:51.336574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:51.339080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 64/133] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:51.346753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:51.600763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3b1c6-e324-4ea6-a7a1-ddd72099087a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:51.647321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cbd4b9-7473-4aef-9601-b6db1c332672 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:51.672672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:51.674102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.674938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.675708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.677723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=04c768af1dc0492aa583b1f66b10218a) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:51.678624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:51.681778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c576e54-5f3a-404f-a7d0-63c0b4fde48e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:51.690617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:51.692330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.693066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.693818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.697826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:51.700894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0495a77-5730-419e-90cc-d9f81fdb6493 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:51.701971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 70/134] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:51 2022] GET /identity/v3/role_assignments?user.id=04c768af1dc0492aa583b1f66b10218a&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=d86c43353dfb47da842c631531e8864f => generated 259 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:51.703261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9fa94-e33c-47d0-87b2-bf66a2451cdf None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.703556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9fa94-e33c-47d0-87b2-bf66a2451cdf None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.703833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9fa94-e33c-47d0-87b2-bf66a2451cdf None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.705207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 71/135] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:51.705752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 65/136] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:51 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:51.714661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9fa94-e33c-47d0-87b2-bf66a2451cdf None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:51.717783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:51.718901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:51.719660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:51.750773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:51.771686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:51.773013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:51.885706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 66/137] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:51.920802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:51.957933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9fa94-e33c-47d0-87b2-bf66a2451cdf None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:52.003094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:52.003734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:52.004017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:52.004340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] PATH_INFO: `/v3/projects/7edaf1e793644339acdc3f3c8e1810f2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:52.010118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] RBAC: Authorizing `identity:get_project(project_id=7edaf1e793644339acdc3f3c8e1810f2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:52.011683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:52.013840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 72/138] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:51 2022] GET /identity/v3/projects/7edaf1e793644339acdc3f3c8e1810f2 => generated 312 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:52.019274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:52.141089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74a76e-225f-4e1e-a832-7cb1cabc092d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:52.177587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:52.178267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:52.178552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:52.178818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] PATH_INFO: `/v3/projects/7edaf1e793644339acdc3f3c8e1810f2/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:52.180756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] RBAC: Authorizing `identity:create_grant(project_id=7edaf1e793644339acdc3f3c8e1810f2, user_id=c26b8fa36ae14513bd7429e75abc8dbe, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:52.182275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:52.185588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:52.199799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 67/139] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:06:52 2022] PUT /identity/v3/projects/7edaf1e793644339acdc3f3c8e1810f2/users/c26b8fa36ae14513bd7429e75abc8dbe/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:06:52.431576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:52.554194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c2c31-8845-4d26-bd26-3e0cc4570958 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:52.596363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:52.596991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:52.597267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:52.597562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:52.602137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:52.603631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d4751-2b8d-4875-a4d0-c59c6a35c439 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:52.605697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 73/140] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:52.611422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:52.726708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fcb4e-7233-4d90-b527-ed829cf16940 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:52.768194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:52.768830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:52.769113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:52.769376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:52.770114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:52.771616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e880f-38cb-43df-968d-b234540fe379 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:52.799215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 68/141] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:06:52 2022] POST /identity/v3/users => generated 283 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:53.821926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17ea9-14dc-4ff2-926c-20a0794c88ad None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:53.823054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17ea9-14dc-4ff2-926c-20a0794c88ad None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:53.823536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17ea9-14dc-4ff2-926c-20a0794c88ad None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:53.825366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 74/142] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:53.832481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04771c-2172-47ae-8022-3d0df9975bbc None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:53.833419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04771c-2172-47ae-8022-3d0df9975bbc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:53.833995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04771c-2172-47ae-8022-3d0df9975bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:53.854166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2b04771c-2172-47ae-8022-3d0df9975bbc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:53.855742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2b04771c-2172-47ae-8022-3d0df9975bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:53.912886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:53.944743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 69/143] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:54.496964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd17ea9-14dc-4ff2-926c-20a0794c88ad None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:54.519821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:54.673867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd17ea9-14dc-4ff2-926c-20a0794c88ad None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:54.697559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f86e1-5a70-4326-842a-f968dd7ed595 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:54.697837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f86e1-5a70-4326-842a-f968dd7ed595 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:54.698176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f86e1-5a70-4326-842a-f968dd7ed595 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:54.699830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 70/144] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:54.706393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba0df-f882-4d49-98e1-399a43a7d07d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:54.706685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba0df-f882-4d49-98e1-399a43a7d07d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:54.706970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aba0df-f882-4d49-98e1-399a43a7d07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:54.750250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d5aba0df-f882-4d49-98e1-399a43a7d07d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:54.752028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d5aba0df-f882-4d49-98e1-399a43a7d07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:54.758382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:54.759607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:54.760224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:54.760878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:54.782480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:54.788017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:54.789546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:54.790794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 75/145] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:54.796094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:54.917523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 71/146] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:06:54.932243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:54.938994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11852e8-9b0a-421e-bfb1-73c7dcee24f4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:54.939363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11852e8-9b0a-421e-bfb1-73c7dcee24f4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:54.939580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11852e8-9b0a-421e-bfb1-73c7dcee24f4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:54.940924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 72/147] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:54.949472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:54.949472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:54.949472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:54.981357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:54.981915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ae3dd-6e33-4379-9520-fa9fc282c3ab None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:54.982603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:55.053094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:55.058678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.059396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.060076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.061421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:55.062151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:55.064582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:55.083000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 76/148] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:55.089316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:55.132107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 73/149] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:55.292073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00c413-cbb1-4302-8660-ed5657d24e97 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:55.354236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:55.355253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.355717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.356135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] PATH_INFO: `/v3/users/b214a184834a4cb0b49321b412607103` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.358162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] RBAC: Authorizing `identity:get_user(user_id=b214a184834a4cb0b49321b412607103)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:55.359677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998d310-29da-490b-97e7-f535835ef40c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:55.361670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 77/150] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:55 2022] GET /identity/v3/users/b214a184834a4cb0b49321b412607103 => generated 247 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:06:55.367367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:55.423662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c527d-9e94-4ad1-9d97-6dd335db986e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.423978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c527d-9e94-4ad1-9d97-6dd335db986e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.424207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c527d-9e94-4ad1-9d97-6dd335db986e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.425758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 78/151] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:06:55.426468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c527d-9e94-4ad1-9d97-6dd335db986e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:55.429769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:55.437765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:55.532190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e61f3-b36b-4af0-85de-037039de0e06 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:55.587876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:55.588506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.588858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.589137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.701907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c527d-9e94-4ad1-9d97-6dd335db986e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:55.714653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:55.716162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:55.798677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:55.799318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.799596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.799866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.804318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:55.834326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-a3705149-9774-4fa8-84f0-2ca3edd2119d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:55.839398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:55.840252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:55.841013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 79/152] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:55.849304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:55.849631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:55.849903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:55.888251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:55.889498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:55.927286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 74/153] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:55.928162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.028728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.042002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 80/154] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:56.042870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.153967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cec08-be4f-4275-80ce-41e9530b2dbf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.229076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.230111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.230766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.231177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.249328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd36ad-9688-483b-ae0d-f30fa0c463d2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.261660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:56.270786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:56.271648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:56.272626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 75/155] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:56.282019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.288659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.344843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.345482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.345760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.346026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.346689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:56.346989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:56.355723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:56.364662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 81/156] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:56.365670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.459217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.504900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797aba-023b-4bb2-be47-9b6c271e1b22 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.540373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.540986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.541259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.541552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.542275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:56.542574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:56.543955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:56.553519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 82/157] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:56.554122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.628532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d347d-927e-4b88-b39f-73dfb71e14bf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.660540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e335b-969c-48b2-a011-0b477d1af67b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.681593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.698128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.699116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.699558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.699971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] PATH_INFO: `/v3/users/04c768af1dc0492aa583b1f66b10218a` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.701321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] RBAC: Authorizing `identity:get_user(user_id=04c768af1dc0492aa583b1f66b10218a)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:56.702939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:56.704702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 83/158] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/users/04c768af1dc0492aa583b1f66b10218a => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:56.705639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.750212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.750784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.751064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.751336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.752733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:56.754011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:56.755735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 76/159] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:56.756517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.814717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9843f07b-1c0f-433b-95ea-dd357cee0b2b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:56.850476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:56.851429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:56.851873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:56.852324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:56.863647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:56.869242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:56.870233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:56.871011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:56.872934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 84/160] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:56.873877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:56.926005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.935454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:56.987695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c218c-3348-4ca3-ac5b-87c10191e1b9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.001411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fa72f-7d2c-4c77-93f8-5a4ff26cc381 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.024948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.026359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.026921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.027402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.028731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.030429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.032707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 85/161] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:57.033690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:57.087760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.088806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.089228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.089746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.091448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.093799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbc9a9-a3e2-45c3-9a2f-3c8b3d9aeb61 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.105951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 77/162] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:56 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:57.107946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c87b-8562-4c30-9876-9e95a63edceb None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.108370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c87b-8562-4c30-9876-9e95a63edceb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.108783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3c87b-8562-4c30-9876-9e95a63edceb None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.111636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 78/163] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:57.112020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3c87b-8562-4c30-9876-9e95a63edceb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:57.147077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010df38-c9b9-4e81-94c2-8a364cda96fd None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.165500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:57.186929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.188266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.188753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.189204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.190201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=b214a184834a4cb0b49321b412607103) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:57.190719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.192820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.200532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 86/164] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:57 2022] GET /identity/v3/role_assignments?user.id=b214a184834a4cb0b49321b412607103&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:57.201968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:57.319018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24adeae2-a60c-4a86-b4f4-7c95449c186e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.328724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3c87b-8562-4c30-9876-9e95a63edceb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.390708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.391431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.391712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.391986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/04c768af1dc0492aa583b1f66b10218a/roles/d86c43353dfb47da842c631531e8864f` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.394043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, user_id=04c768af1dc0492aa583b1f66b10218a, role_id=d86c43353dfb47da842c631531e8864f)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.395508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.419615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 87/165] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:06:57 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/users/04c768af1dc0492aa583b1f66b10218a/roles/d86c43353dfb47da842c631531e8864f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:06:57.421751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:57.434859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.435933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.436355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.436825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.437873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:57.438387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.440883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c49a89-2760-4b07-9f23-038407bbbab5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.463496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 79/166] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:06:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:57.470022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.470618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.471046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.478210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:57.504993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:57.522571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:57.523827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:57.617866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b3441-5f81-42e3-9198-232a42052910 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:57.712963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:57.713973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.714395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.715182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.732700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 80/167] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:57.734116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:57.818215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:57.819747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff42710-8396-49e0-9299-86cf559590b5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:57.930091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:57.933157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 88/168] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:57.935336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eaf1e-8737-432e-a06b-0f7eb68b2382 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:57.935619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eaf1e-8737-432e-a06b-0f7eb68b2382 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:57.935889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eaf1e-8737-432e-a06b-0f7eb68b2382 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:57.938704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 89/169] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:57.939465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eaf1e-8737-432e-a06b-0f7eb68b2382 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.112688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d6ec70-bca7-47ba-b2be-465b2861d9d8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.169103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.182512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.183385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.183813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.184225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.189779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eaf1e-8737-432e-a06b-0f7eb68b2382 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.190463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:58.192789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a796d358-a953-45da-a865-d7da8b904f13 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:58.195737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 81/170] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:57 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:58.201434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.201434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.201434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.224486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:58.226253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:58.250569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.251854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.252531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.253230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.255289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:58.257862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4786ac5b-40ee-45e8-937e-c9771b282225 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:58.261362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 90/171] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:57 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:58.263496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4881d1-7dce-4b33-a617-74e2cf945304 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.264138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4881d1-7dce-4b33-a617-74e2cf945304 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.264760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4881d1-7dce-4b33-a617-74e2cf945304 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.267372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 91/172] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:58.268691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4881d1-7dce-4b33-a617-74e2cf945304 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.288991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.335684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 82/173] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:58.336359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.447847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4881d1-7dce-4b33-a617-74e2cf945304 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.490122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a4efe-8754-4944-8018-b8626ef3f72a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.517749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.518393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.518672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.518946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.524440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.531606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:58.534439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.535300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.535770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.536228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:58.538645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:58.539518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:58.540295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 92/174] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:58.540953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.615618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.619361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:58.621032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74f160-1f38-4edc-8fcc-b2c2195b4536 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:58.653043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f3c9c-06a0-498f-9967-94ddaa8b5b7c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.692295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.693006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.693285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.693587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.694327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:58.694635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:58.696079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec1d00-78cd-42d5-8c94-5a476437a769 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:58.702773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 93/175] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:58 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=0fb732effc6f492c9a998d105764e845 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:58.704013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.704300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.704567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.724977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:58.726296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:58.736894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 83/176] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:58.738852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254386a-007f-47e2-8719-e6d0f0c318ec None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.739379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254386a-007f-47e2-8719-e6d0f0c318ec None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.739858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254386a-007f-47e2-8719-e6d0f0c318ec None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.741535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 84/177] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:58.747025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254386a-007f-47e2-8719-e6d0f0c318ec None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.783332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.805813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 94/178] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:58.807455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:58.877921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254386a-007f-47e2-8719-e6d0f0c318ec None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.878554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:58.925297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:58.926121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.926679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.927101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.927885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:58.928292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:58.930264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fd5e5-ee98-4efa-b921-7af07967601a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:58.941165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 85/179] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:58.942886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:58.943299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:58.943687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:58.957083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3667b8d-36d6-4c7c-a9aa-affd8b8b3d4b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:58.975011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:06:58.976894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:06:59.002602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.003336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.003678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.004011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.005959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.007496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.009906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 95/180] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:59.010612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.083878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 86/181] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:06:59.084860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.110754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.180246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be93437-31bb-410e-bafa-337e5db7d5de None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.214931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec6323-99c1-419d-a1a6-9098787b6910 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.221499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.235444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.236987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.237738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.238413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.240551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.242269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.245092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 96/182] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:59.246890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.258924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.260183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.260527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.260800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] PATH_INFO: `/v3/users/c26b8fa36ae14513bd7429e75abc8dbe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.261972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] RBAC: Authorizing `identity:get_user(user_id=c26b8fa36ae14513bd7429e75abc8dbe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.263954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.266732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 87/183] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/users/c26b8fa36ae14513bd7429e75abc8dbe => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:59.267411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.384819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd4432-7712-488a-bfcd-1e2dddd447ab None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.393835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.408216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dff3e-b241-47a1-8c5e-4a56a5c04275 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.427689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.428621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.428907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.429177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.429872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.431787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.450248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.451131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.451604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.451997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.473773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 97/184] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:06:59 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:06:59.473773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.474029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:59.477699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:59.478824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:06:59.479681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:06:59.480471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 88/185] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:59.481990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.565138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.613993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c5947-e8f6-4033-ad0c-40c76456b174 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.642027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e075a-15ff-4f72-b740-23881b586c33 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.660236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.660853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.661130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.661413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.681800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.690556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.690556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.692094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.692094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.692885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:06:59.693199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.695153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.704217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 98/186] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=c388505e96244703b71034784851f8f0 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:06:59.705695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.757724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:06:59.759798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:06:59.859912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254c8b-411d-4283-a787-3e5bc532cb15 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:06:59.880719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:06:59.906061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 89/187] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:06:59.906267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:06:59.906808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.907089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.907358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.908082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.927524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-36b838bb-3e2e-48bb-ade0-c248103d7a8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:06:59.934360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:06:59.935297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:06:59.936077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 99/188] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:06:59.937412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63847-353f-4100-926a-eea72ea68324 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:06:59.938437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63847-353f-4100-926a-eea72ea68324 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:06:59.938710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce63847-353f-4100-926a-eea72ea68324 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:06:59.940124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 100/189] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:06:59.941860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63847-353f-4100-926a-eea72ea68324 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:06:59.980417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.044144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c484d0c-9502-48b7-b557-4823f4449267 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.088201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce63847-353f-4100-926a-eea72ea68324 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.088744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.089551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.089835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.090108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.090798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:00.091098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.093634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.102682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 90/190] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.103576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.134817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.136178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.136886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.137347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] PATH_INFO: `/v3/projects/7edaf1e793644339acdc3f3c8e1810f2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.139125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] RBAC: Authorizing `identity:get_project(project_id=7edaf1e793644339acdc3f3c8e1810f2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.141018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de343e25-3489-46f8-a5e5-069c43a36d54 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.143826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 101/191] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:06:59 2022] GET /identity/v3/projects/7edaf1e793644339acdc3f3c8e1810f2 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.145304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.145800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.146078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.172271 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:00.173504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:00.224134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.241136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe1275-a3ca-48f4-aa08-d77c50049f7c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.255236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.261480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 102/192] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:00.263904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.304744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.307303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.307817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.308275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.309314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:00.318086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.318086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.328891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 91/193] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.330114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.441624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83d46e-31f6-47e6-be66-9622f351a8e6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.507112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.508094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.509191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.510181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.521857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b5140-8980-4848-9dc5-00312ab770d1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.536145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.538495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.541569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 103/194] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.543395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.571485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.572401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.572770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.573152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.574373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=7edaf1e793644339acdc3f3c8e1810f2, user.id=c26b8fa36ae14513bd7429e75abc8dbe) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:00.574373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.576505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.587053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 92/195] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/role_assignments?user.id=c26b8fa36ae14513bd7429e75abc8dbe&scope.project.id=7edaf1e793644339acdc3f3c8e1810f2&role.id=0fb732effc6f492c9a998d105764e845 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.588046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.599078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.675486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.725448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440234c8-ccbd-48a7-8ce0-833075bdc12e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.771971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.772856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.773298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.773739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.775960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.778065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.780438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 104/196] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:00.781522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:00.794760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbb327-eafc-441d-94f7-e3e12d7baf29 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.834546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.835155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.835456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.835758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.915821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4da0d-3966-4c4d-be6a-023154a6ac69 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:00.917801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.924275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:00.926084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:00.958551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:00.959460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:00.959875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:00.960280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:00.962925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:00.972067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:00.979233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:00.980324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:00.981275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:00.983247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 105/197] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:00.984187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.056339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 93/198] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:01.057493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.126192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272430-69ab-42c0-aa00-cba38b2b99b4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.161990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f2a7f-bc43-49cb-b1f6-1423612c91d9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.171156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.171773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.172051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.172774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.204597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.205946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.206399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.206883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.207984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:01.208429 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.210705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.214032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.221758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.226900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 94/199] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.228182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.265796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.268611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.343721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c6349-0557-4b4e-bc87-ebc9fae0b98f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.386281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.387171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.387589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.387699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 106/200] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:01.388105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.388731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.389613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.391285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.393759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 95/201] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.394782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.458000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.463515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.500021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe9e50-7f40-473d-9c23-83effa689ca8 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.501067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e85a91-029b-428c-9d27-e1708eddd539 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.536932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.537888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.538001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.538429 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.538858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.538966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.539285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.539641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] PATH_INFO: `/v3/users/04c768af1dc0492aa583b1f66b10218a` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.540571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.541021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=04c768af1dc0492aa583b1f66b10218a)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.542460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.542752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.544761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 96/203] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.546067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.549468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 107/203] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/users/04c768af1dc0492aa583b1f66b10218a => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.551519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.677525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432d4e-b2fb-461e-9b02-342190a6c5a2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.678967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac845a-0c35-4cdc-a1ee-fa20154c1339 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.714797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.725593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.726472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.726913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.727376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.729278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.730023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.730393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.731111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.732061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=33727c35443f4f44a1395899cfe91dc5) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:01.733612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.735391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.737485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:01.744748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 97/204] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/role_assignments?user.id=33727c35443f4f44a1395899cfe91dc5&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.745857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:01.831693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.833784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f80ec1-751d-4029-a75e-953e31cb885a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.870945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362abcd3-72bc-458b-a925-f99686433fe7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:01.912581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:01.913605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.914106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.914587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.915544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=33727c35443f4f44a1395899cfe91dc5) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:01.916143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:01.917944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10844ec7-6140-44fe-ad0c-b26f610b3a33 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:01.924464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 98/205] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/role_assignments?user.id=33727c35443f4f44a1395899cfe91dc5&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=c388505e96244703b71034784851f8f0 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:01.926010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da15e-6c04-4ddc-a08d-247ccff7fada None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.926302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da15e-6c04-4ddc-a08d-247ccff7fada None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.926578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81da15e-6c04-4ddc-a08d-247ccff7fada None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.932582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 99/206] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:01.932582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf0cd3-e379-491f-8536-dedd100e7425 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.932582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf0cd3-e379-491f-8536-dedd100e7425 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.932582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf0cd3-e379-491f-8536-dedd100e7425 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.933648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 100/207] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:01.936722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:01.937016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:01.937272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:01.958713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:01.960569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:01.999482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 108/208] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:02.001164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.001772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.002224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.028074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:02.029665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:02.057988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.071106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.081744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 101/209] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:02.082988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.182283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 109/210] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:02.217536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7308a04-d90d-4cda-b74a-077209d23be1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.266678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.267375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.267657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.267981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.274155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:02.276008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:02.277986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 102/211] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:02.286392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.399560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf82d0f2-afdf-4aad-a2c0-da839eaad48b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.406119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.439914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.440529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.440809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.441084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.441856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, scope.project.id=1019d4ac665d428c8fe31e8f29838af6, user.id=04c768af1dc0492aa583b1f66b10218a) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:02.442166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:02.444309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:02.450442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 110/212] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/role_assignments?user.id=04c768af1dc0492aa583b1f66b10218a&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=d86c43353dfb47da842c631531e8864f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:02.472661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.518079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd34e-96e5-4ceb-b653-7bfbaf8d566e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.555270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.556354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.556830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.557375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.569596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:02.575093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:02.575986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:02.576772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:02.579583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 103/213] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:02.585696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.614121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.649132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.751741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fe8a1-1202-4d39-a53a-d38829e04ec8 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.799448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.800072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.800349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.800683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.802149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:02.802149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:02.803516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:02.818628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 111/214] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:02.819643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.826782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3a3e-503a-4d22-aecf-6754e97872d2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.850249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.867730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.868958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.869535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.870082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.871462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:02.873272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:02.875440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 104/215] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:02.881658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:02.912108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:02.928367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8401cc6-3148-485d-8490-7050a678598f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:02.964578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:02.965215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:02.965525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:02.965796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] PATH_INFO: `/v3/users/594b163f059a4f79b17e28610e1b99b6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:02.980441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] RBAC: Authorizing `identity:get_user(user_id=594b163f059a4f79b17e28610e1b99b6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:02.982205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:02.984202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 112/216] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/users/594b163f059a4f79b17e28610e1b99b6 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:02.990027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:03.002508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34daa63-1ab8-4702-aee9-73d1b416b8f4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:03.043020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:03.044062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:03.044559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:03.045066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:03.046189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:03.047900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:03.074373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 105/217] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:02 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:07:03.097173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efee458-8e7f-4a4c-821c-34fbd73961e9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:03.136315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:03.136944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:03.137218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:03.137519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:03.194134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:03.251930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:03.253484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:03.370885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 113/218] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:03.376998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:03.439002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:03.502294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fcc9b-237a-4918-b173-3ebd2c477cb8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:03.539367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:03.540342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:03.540816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:03.541303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:03.542711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:03.544374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c7fd-7dbf-4cfe-b379-1072ce5e224d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:03.546590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 106/219] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:03 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:03.552738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:03.601880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:03.657942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f4a3e-055a-45de-920a-de17aebc3448 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:03.693803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:03.694780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:03.695254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:03.695747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:03.696674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=594b163f059a4f79b17e28610e1b99b6) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:03.697172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:03.698976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35266848-6cf4-41fa-bc1f-0203ef5ecd21 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:03.705738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 114/220] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:03 2022] GET /identity/v3/role_assignments?user.id=594b163f059a4f79b17e28610e1b99b6&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=0fb732effc6f492c9a998d105764e845 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:04.204146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cb16-c4dd-4699-88b0-4c9429e5554f None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:04.204711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cb16-c4dd-4699-88b0-4c9429e5554f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:04.204990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011cb16-c4dd-4699-88b0-4c9429e5554f None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:04.206539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 107/221] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:04.212609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f46ac6-d8a2-413a-a545-c6fe7b0761f7 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:04.212892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f46ac6-d8a2-413a-a545-c6fe7b0761f7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:04.213166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f46ac6-d8a2-413a-a545-c6fe7b0761f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:04.235787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-97f46ac6-d8a2-413a-a545-c6fe7b0761f7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:04.236986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-97f46ac6-d8a2-413a-a545-c6fe7b0761f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:04.336628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 115/222] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:04.686060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011cb16-c4dd-4699-88b0-4c9429e5554f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:04.760420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a027e9-1430-49db-b936-50bdb50a5e20 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:04.761375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a027e9-1430-49db-b936-50bdb50a5e20 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:04.761868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a027e9-1430-49db-b936-50bdb50a5e20 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:04.764660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 116/223] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:04.769183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:04.769732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:04.770199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:04.795071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:04.798198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:04.830965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011cb16-c4dd-4699-88b0-4c9429e5554f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:04.853221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:04.865794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:04.897773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:04.898424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:04.898705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:04.898978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:04.918577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:04.924414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:04.925362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:04.926236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:04.929824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 108/224] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:04.933412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:04.954643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 117/225] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:05.084176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b974c-1a2e-4370-9989-04113e7347f0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.132928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.133586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.133869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.134141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.134824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:05.135125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.136549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:05.146020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 109/226] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:05.151887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.297516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28b67a-bcea-46c3-8adc-dc399805e918 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.314758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.351313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.352062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.352336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.352708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.355627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.357329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:05.363724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 118/227] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:05.366261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.368970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:05.438045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:05.473095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2be88-0876-4196-9b24-9c1ae985e211 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.512895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd53773-d5ff-4e5c-83f2-a03b88af8b39 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.515495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.516340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.516791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.517230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.529688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fd23effd-e55d-4e1f-a521-42051426c78c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:05.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:05.538674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:05.539466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:05.546745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 110/228] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:05.548578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7771a-4ba1-4d92-9a42-1fa28544e7aa None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.549099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7771a-4ba1-4d92-9a42-1fa28544e7aa None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.549807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7771a-4ba1-4d92-9a42-1fa28544e7aa None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.550210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.550854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.551134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.551407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.552379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 111/229] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:05.552583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.553411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7771a-4ba1-4d92-9a42-1fa28544e7aa None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.558911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc16da-1e41-41bf-8bb2-bdcea9ff00de None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:05.567959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 119/230] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:05.569641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.570604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.571022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.596434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:05.598257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:05.680287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:05.686200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 120/231] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:05.687383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.703190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7771a-4ba1-4d92-9a42-1fa28544e7aa None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.765324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:05.781050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.782035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.782497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.783078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.783926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:05.784422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.786001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:05.796725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 112/232] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:05.802849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.910789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdae5-de1b-407e-9669-371f58803d8c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.915789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed327afb-128a-4362-9fef-f8d539dacb4c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:05.949000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.950055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.952858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.953357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.954935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.956914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:05.959913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 113/233] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:05.968922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:05.991829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:05.993118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:05.993974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:05.994429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/users/33727c35443f4f44a1395899cfe91dc5/roles/c388505e96244703b71034784851f8f0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:05.997622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, user_id=33727c35443f4f44a1395899cfe91dc5, role_id=c388505e96244703b71034784851f8f0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:05.999701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.001375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.018184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 121/234] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:05 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/users/33727c35443f4f44a1395899cfe91dc5/roles/c388505e96244703b71034784851f8f0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:06.019367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.140069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.140451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159bbde-d376-425a-abbc-76d6a8584ab9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.149443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96dcff6-1968-45b2-a230-d13af325b208 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.190183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.190390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.190831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.190998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.191177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.191265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.191487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.191581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.192881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.194639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0cf25-0574-41cb-b50b-bdc6cb606dc5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.196672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 114/235] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:05 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:06.198135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aab74-60f7-4c68-9aa7-5888ac8003f0 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.198421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aab74-60f7-4c68-9aa7-5888ac8003f0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.198695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aab74-60f7-4c68-9aa7-5888ac8003f0 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.200298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 115/236] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:06.210473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aab74-60f7-4c68-9aa7-5888ac8003f0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.212396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-48e8a691-f01a-402f-b511-d48001bb46d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:06.221447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:06.222444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 122/237] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:06.223224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b373-c295-463a-8108-61021cb73eae None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.223975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b373-c295-463a-8108-61021cb73eae None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.223975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950b373-c295-463a-8108-61021cb73eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.246261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0950b373-c295-463a-8108-61021cb73eae None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:06.247328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0950b373-c295-463a-8108-61021cb73eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:06.332498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 123/238] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:06.333437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950b373-c295-463a-8108-61021cb73eae None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.340846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.351632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aab74-60f7-4c68-9aa7-5888ac8003f0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.388158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.388932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.389214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.389585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/users/33727c35443f4f44a1395899cfe91dc5/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.391603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, user_id=33727c35443f4f44a1395899cfe91dc5, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.393341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ef221-f8c4-4227-a1d5-042719b7d78a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.411341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 116/239] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:06 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/users/33727c35443f4f44a1395899cfe91dc5/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:06.412788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222a1a-984d-4f09-9554-263eed047db4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.413076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222a1a-984d-4f09-9554-263eed047db4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.413346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc222a1a-984d-4f09-9554-263eed047db4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.414976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 117/240] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:06.420659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.420943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.421271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.426485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.442980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:06.444226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950b373-c295-463a-8108-61021cb73eae None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.444332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:06.483771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.484400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.484875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.485162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.486343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:06.486942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.488377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.500758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 124/241] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:06.507093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.564187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 118/242] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:06.624217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af11cc4-a2f9-4c73-ab02-9e62c568d185 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.663479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.664041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.664318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.664587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] PATH_INFO: `/v3/users/ac72dbcc45224612b5ee124a82f4d2a3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.686764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ac72dbcc45224612b5ee124a82f4d2a3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.688288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.690311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 125/243] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/users/ac72dbcc45224612b5ee124a82f4d2a3 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:06.696208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.726249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.730260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.821204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:06.840783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ac00b-7593-4b17-999c-63f0d696d5b9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.876990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.877645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.879427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.879713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.914005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413750a3-c673-4bca-9c53-e6cfc50987d2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:06.952984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:06.954158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:06.954629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:06.955087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:06.956539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.959858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:06.962810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 126/244] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:06.963849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:06.975905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:06.978942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.054643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.081885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.094158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115fb4-1f94-4d96-b8a0-e96a297e9624 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.095572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 119/245] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:07.096776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.137042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.138345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.138807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.139376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.151749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:07.156891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:07.158096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:07.158930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:07.165969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 127/246] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:07.167079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.225922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb4193-7168-42fd-ad7f-4181faf2a6c2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.262891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.263925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.264444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.264906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.265831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.268694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.274645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e62189-3f49-42b6-8ba8-a02a3ae06484 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.294054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 120/247] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:07 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:07.295426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.325792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.341936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.342996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.345040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.345640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.349110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.351007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.357875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 128/248] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:07 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:07.362567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.367308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.440267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190393cd-1faf-4a0f-a51c-17d0ee4d0a7c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.482235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.483298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.483795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.484261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.485147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:07.485714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.487935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.502763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 121/249] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:07.505850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.610785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0882140-b98c-4347-83dc-f9d8f23d537a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.634180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f50825-5ab4-404d-bc32-b3a5edd4a6e4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.637760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.655599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744662c-155f-4978-b460-1770876a4241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.656211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744662c-155f-4978-b460-1770876a4241 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.656484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744662c-155f-4978-b460-1770876a4241 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.656751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744662c-155f-4978-b460-1770876a4241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.657506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744662c-155f-4978-b460-1770876a4241 None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=ac72dbcc45224612b5ee124a82f4d2a3) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:07.657811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744662c-155f-4978-b460-1770876a4241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.659268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744662c-155f-4978-b460-1770876a4241 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.665370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 129/250] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:07 2022] GET /identity/v3/role_assignments?user.id=ac72dbcc45224612b5ee124a82f4d2a3&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=d86c43353dfb47da842c631531e8864f => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:07.676857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.677575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.677862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.678139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] PATH_INFO: `/v3/users/594b163f059a4f79b17e28610e1b99b6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.679472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] RBAC: Authorizing `identity:get_user(user_id=594b163f059a4f79b17e28610e1b99b6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.681052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.687952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 122/251] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:07 2022] GET /identity/v3/users/594b163f059a4f79b17e28610e1b99b6 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:07.689487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744662c-155f-4978-b460-1770876a4241 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.795048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:07.839113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744662c-155f-4978-b460-1770876a4241 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:07.882564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:07.883214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:07.883491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:07.883761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:07.885637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:07.887106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f73f7-6e30-4da4-a082-b12cff20f089 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:07.888940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 130/252] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:07 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:07.894804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:07.999139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8590-b36d-471e-9ac1-5d8b275138ed None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:08.034361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:08.035036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:08.035315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:08.035601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/users/594b163f059a4f79b17e28610e1b99b6/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:08.037558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, user_id=594b163f059a4f79b17e28610e1b99b6, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:08.039030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef7f94-dd93-4a9b-ac5e-08942831b0a8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:08.057636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 123/253] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:07 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/users/594b163f059a4f79b17e28610e1b99b6/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:08.234466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2c1b-ea03-4ce6-9ac3-8ecd5680129c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:08.234994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2c1b-ea03-4ce6-9ac3-8ecd5680129c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:08.234994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c2c1b-ea03-4ce6-9ac3-8ecd5680129c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:08.236672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 131/254] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:08.241864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30e30-08a3-4563-9881-f1b47ade7712 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:08.242140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30e30-08a3-4563-9881-f1b47ade7712 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:08.242415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b30e30-08a3-4563-9881-f1b47ade7712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:08.261736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-79b30e30-08a3-4563-9881-f1b47ade7712 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:08.262938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-79b30e30-08a3-4563-9881-f1b47ade7712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:08.292107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:08.346047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 124/255] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:08.690042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afb9e-40e2-46d4-8aee-499311a912d1 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:08.690433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afb9e-40e2-46d4-8aee-499311a912d1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:08.690603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9afb9e-40e2-46d4-8aee-499311a912d1 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:08.692320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 132/256] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:08.707258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:08.707559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:08.707802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:08.730647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:08.731843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:08.818157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 125/257] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:08.876786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afb9e-40e2-46d4-8aee-499311a912d1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.019154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9afb9e-40e2-46d4-8aee-499311a912d1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.058391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:09.064251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.065157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.065648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.066329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.080468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:09.085777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:09.086645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:09.087422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:09.093736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 133/258] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:09.099905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.210631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:09.229532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b358f0-8602-41de-abf7-907e4fc81b18 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.271568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.271946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.272230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.272505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.273171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:09.273493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:09.274906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:09.284827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 126/259] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:09.290708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.425430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.433933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709409d-59b3-4d4c-962e-9666800e9e2e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.477912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.478565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.478842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.479114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.481054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:09.483984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:09.485814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 134/260] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:09 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:09.492477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.595016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62305993-2b57-4af8-b586-cf10d1acaaa8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.654873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:09.657096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.659095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.659381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.659656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.680296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:09.686231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:09.687613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:09.688995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 127/261] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:09.694532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:09.713102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:09.782732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0b0e1-881a-49ab-9b91-43b8365325ac None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.881265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342460a5-575f-45b8-9151-f9cc11e0e8df None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:09.891736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.892933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.893675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.894602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.980907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:09.981547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:09.981834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:09.982109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:09.982782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:09.983090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:09.984477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:09.998524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:10.000035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633b39-2eb1-45a8-9a78-4386d99d2100 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:10.004980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 128/262] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:10.014396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:10.122977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:10.231525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:10.239542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 135/263] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:10.240826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1952-e8af-4ddf-9e29-d04ceb8388fd None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.241198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1952-e8af-4ddf-9e29-d04ceb8388fd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.241494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd1952-e8af-4ddf-9e29-d04ceb8388fd None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.243037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 136/264] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:10.248834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1952-e8af-4ddf-9e29-d04ceb8388fd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:10.280514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5d472-f438-42ef-bb55-f134ebdb1077 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:10.317869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:10.318525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.318808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.319536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] PATH_INFO: `/v3/users/33727c35443f4f44a1395899cfe91dc5` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.321434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] RBAC: Authorizing `identity:get_user(user_id=33727c35443f4f44a1395899cfe91dc5)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:10.324367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48faaa-0ff4-49d7-bd1e-1c81371685b9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:10.327574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 129/265] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/users/33727c35443f4f44a1395899cfe91dc5 => generated 283 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:10.332244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.332528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.332798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.369299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:10.370587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:10.441825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 130/266] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:10.442705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:10.506183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd1952-e8af-4ddf-9e29-d04ceb8388fd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:10.521815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:10.575393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6eb2b-0992-4a12-8f81-44f9b3480128 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:10.591944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:10.592594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.592876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.593150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.594308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:10.595777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:10.597758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 137/267] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:10.604193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:10.646573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:10.666137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:10.666843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.667124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.667397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.786635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd52301-5698-413e-abac-bcb83e63c330 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:10.797626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:10.799153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c7a4-92e7-4ec8-bf9e-a6bbccd21e96 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:10.851118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:10.851729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.852002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.852268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.853008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=33727c35443f4f44a1395899cfe91dc5) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:10.853312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:10.857154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:10.871776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 138/268] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/role_assignments?user.id=33727c35443f4f44a1395899cfe91dc5&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=c388505e96244703b71034784851f8f0 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:10.872637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:10.924277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:10.967004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 131/269] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:10.968986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874878d-591d-4b9d-9228-8d0086d3aef3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.969527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874878d-591d-4b9d-9228-8d0086d3aef3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.969946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874878d-591d-4b9d-9228-8d0086d3aef3 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.971783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 132/270] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:10.973443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9354-e3fe-480e-ace7-69e565d85380 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:10.974586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9354-e3fe-480e-ace7-69e565d85380 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:10.975030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9354-e3fe-480e-ace7-69e565d85380 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:10.977204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 133/271] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:10.978630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9354-e3fe-480e-ace7-69e565d85380 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.039730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.051338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00c7a1-6cca-4b22-bdf5-302ec86ebb15 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.098702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.099359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.099636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.099912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.114117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-7b1e7c79-480a-4834-9cde-e9a75dfc0226 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:11.119833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:11.120798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:11.121641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 139/272] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:11.122969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536286-5ed3-42cd-bf06-8198bf9b04a2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.123411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536286-5ed3-42cd-bf06-8198bf9b04a2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.123801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12536286-5ed3-42cd-bf06-8198bf9b04a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.128292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9354-e3fe-480e-ace7-69e565d85380 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.142846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-12536286-5ed3-42cd-bf06-8198bf9b04a2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:11.144066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-12536286-5ed3-42cd-bf06-8198bf9b04a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:11.170054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.170714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.170991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.171263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.172537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.174080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0863c34-7af8-4612-8355-846041a68dc2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.175815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 134/273] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:10 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.175815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348dd27-d554-4041-8a80-600419994034 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.175815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348dd27-d554-4041-8a80-600419994034 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.175815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348dd27-d554-4041-8a80-600419994034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.197371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b348dd27-d554-4041-8a80-600419994034 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:11.198751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b348dd27-d554-4041-8a80-600419994034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:11.217900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 140/274] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:11.219229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d7ba-2d02-4250-a796-2b6583c96598 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.219515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d7ba-2d02-4250-a796-2b6583c96598 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.219783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df7d7ba-2d02-4250-a796-2b6583c96598 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.221446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 141/275] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:11.226336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7d7ba-2d02-4250-a796-2b6583c96598 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.234600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.282297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 135/276] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:11.283207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348dd27-d554-4041-8a80-600419994034 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.346662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.375880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df7d7ba-2d02-4250-a796-2b6583c96598 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.408178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348dd27-d554-4041-8a80-600419994034 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.422753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.423726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.424230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.424769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.425810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:11.426312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.428006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d2e9c-764a-4b1e-8f7b-a439233b927b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.438088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 142/277] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.439897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.440437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.441205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.446913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.447610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.447895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.448170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.449023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=33727c35443f4f44a1395899cfe91dc5) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:11.449333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.451128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.457536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 136/278] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/role_assignments?user.id=33727c35443f4f44a1395899cfe91dc5&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.458373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.463963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:11.465756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:11.493700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.548067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 143/279] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:11.548067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.581661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809752fa-e68c-4438-a690-e36308ce26f8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.621329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.622355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.622899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.623305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] PATH_INFO: `/v3/users/ac72dbcc45224612b5ee124a82f4d2a3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.624605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] RBAC: Authorizing `identity:get_user(user_id=ac72dbcc45224612b5ee124a82f4d2a3)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.626521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.628673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 137/280] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/users/ac72dbcc45224612b5ee124a82f4d2a3 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.629766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.641763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.676706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d998d-918d-4a52-a0ff-cb41bf47d99d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.716191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.716840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.717123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.717413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.731580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:11.736968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:11.737908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:11.738683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:11.739305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 144/281] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:11.739812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.756591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.760948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec4488-c691-409d-8207-7ed2da7d4014 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.801593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.802226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.802509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.802783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.814391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:11.820901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:11.821962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 138/282] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:11.823084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.857079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e33ede-bbc4-44c8-9f69-2ae9fba353d4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.893318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.893979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.894261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.894574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.895767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.897215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.898881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 145/283] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.899637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.902558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:11.929607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f094-cb97-44b9-9a39-1ce6a3b49c6a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.962617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:11.963234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:11.963530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:11.963796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:11.964465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:11.964759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:11.966176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:11.973930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 139/284] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:11.974694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:11.997606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd376ec3-f4be-49eb-9197-cd280dbbc1b0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:11.998522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.032110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.032704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.032978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.033241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.033927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:12.034222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.035576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.043603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 146/285] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:12.044347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.074356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dba4d-686e-467e-b6ec-a7f100442c41 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.104402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.114774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.115615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.116025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.116422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.118045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.120320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.122916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 140/286] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:12.123835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.151487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfa801-ba67-41b3-846d-fdc0dc652d39 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.200552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.201214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.201521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.201791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/users/ac72dbcc45224612b5ee124a82f4d2a3/roles/d86c43353dfb47da842c631531e8864f` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.203730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, user_id=ac72dbcc45224612b5ee124a82f4d2a3, role_id=d86c43353dfb47da842c631531e8864f)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.205380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.222031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 147/287] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:12 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/users/ac72dbcc45224612b5ee124a82f4d2a3/roles/d86c43353dfb47da842c631531e8864f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:12.223294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.238932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.253521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb3087-a1da-4e51-a88d-680cc7b039e4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.298253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.298908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.299188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.299460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] PATH_INFO: `/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.315407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] RBAC: Authorizing `identity:get_user(user_id=94d0b4e94bbe4d64a5ab10b9dc0e33a3)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.317275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.324299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 141/288] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:12 2022] GET /identity/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:12.324299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.371211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be6dab-2ca8-45c2-b057-6089cb288dba None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.402515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.414850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.415488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.416015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.416015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] PATH_INFO: `/v3/users/594b163f059a4f79b17e28610e1b99b6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.417315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] RBAC: Authorizing `identity:get_user(user_id=594b163f059a4f79b17e28610e1b99b6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.418832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.420758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 148/289] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:12 2022] GET /identity/v3/users/594b163f059a4f79b17e28610e1b99b6 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:12.425507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.441521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f578aa3-ce06-4ed7-bbaa-980b044a8301 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.475207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.475822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.476104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.476378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.477036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.478546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.501145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 142/290] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:12 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:12.501988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.505505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.563915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7546ad-909c-4cad-a58d-a1eb6bf28a0b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.606700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.607716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.608170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.608630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.609581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, user.id=94d0b4e94bbe4d64a5ab10b9dc0e33a3, scope.system=all) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:12.610154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.612085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.618913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 149/291] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Aug 27 02:07:12 2022] GET /identity/v3/role_assignments?user.id=94d0b4e94bbe4d64a5ab10b9dc0e33a3&scope.system=all&role.id=0fb732effc6f492c9a998d105764e845 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:12.631823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b00dd-c1bf-470d-a7ab-4c639f544e97 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:12.675399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:12.676426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:12.676924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:12.677202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:12.756513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:12.758133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:12.761430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.870279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 143/292] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:12.876058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:12.936323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:12.988681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d68a6-9c56-4d13-927d-82e5381ca564 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:13.029563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:13.030623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:13.031123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:13.031613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:13.033839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:13.035806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067363-6f2d-4ff8-85da-88be4443181e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:13.038256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 150/293] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:12 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:13.045142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:13.172125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a188bb3-a36d-4fdd-998b-cef5f8d8adce None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:13.174551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:13.207182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:13.207710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:13.207988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:13.208257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:13.208989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=594b163f059a4f79b17e28610e1b99b6) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:13.209295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:13.210759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88856e42-559d-432e-bd78-2573c62c6537 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:13.216873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 144/294] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:13 2022] GET /identity/v3/role_assignments?user.id=594b163f059a4f79b17e28610e1b99b6&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=0fb732effc6f492c9a998d105764e845 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:14.276790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eac86-09e1-4a2e-8c4d-6151adfebb3c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.277319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eac86-09e1-4a2e-8c4d-6151adfebb3c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.277319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eac86-09e1-4a2e-8c4d-6151adfebb3c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.278958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 151/295] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:14.284332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0c13-6832-4039-9beb-6c9318ac0e3b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.285137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0c13-6832-4039-9beb-6c9318ac0e3b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.285639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a0c13-6832-4039-9beb-6c9318ac0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.304228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ff4a0c13-6832-4039-9beb-6c9318ac0e3b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:14.311299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ff4a0c13-6832-4039-9beb-6c9318ac0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:14.386973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 145/296] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:14.651005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eac86-09e1-4a2e-8c4d-6151adfebb3c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:14.669352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836d00-36e7-452f-96a7-e395d7466e1c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.669677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836d00-36e7-452f-96a7-e395d7466e1c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.669964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c836d00-36e7-452f-96a7-e395d7466e1c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.671577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 146/297] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:07:14.676596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.676876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.677148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.700724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:14.700724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:14.762295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eac86-09e1-4a2e-8c4d-6151adfebb3c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:14.782079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 147/298] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:14.793325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:14.805721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:14.806350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.806623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.806950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.818035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-3bae9a6d-e20f-49c5-81b0-a952410984a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:14.822781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:14.823651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:14.824423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 152/299] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:14.831495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:14.840863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9877-d89f-4361-95a7-d14e02d641f6 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.841202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9877-d89f-4361-95a7-d14e02d641f6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.841390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d9877-d89f-4361-95a7-d14e02d641f6 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.843006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 153/300] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:07:14.848905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7061f-8609-44bb-92b5-59daa4fd0d9a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.849354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7061f-8609-44bb-92b5-59daa4fd0d9a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.849848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7061f-8609-44bb-92b5-59daa4fd0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.866203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:14.869067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e8b7061f-8609-44bb-92b5-59daa4fd0d9a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:14.870887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e8b7061f-8609-44bb-92b5-59daa4fd0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:14.943869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0689af4-303b-4bc5-833c-fc2b6e2d35c0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:14.945672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 154/301] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:14.946881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825fb5-69d0-4d2f-965a-ebb66794e0d5 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.947158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825fb5-69d0-4d2f-965a-ebb66794e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.947478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94825fb5-69d0-4d2f-965a-ebb66794e0d5 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.952855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 155/302] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:14.954532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.954808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.955077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.973883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:14.974939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:14.991717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:14.992794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:14.993620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:14.994085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:14.994930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:14.995395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:14.997606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.008591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 148/303] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.014092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.049056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 156/304] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:15.049922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.095736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.118114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.120532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c893-3417-4643-9c6c-f2647fab646b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.151892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d59c0-6d40-41c0-8a56-af2a35efe1d4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.155989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.156648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.156927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.157195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] PATH_INFO: `/v3/users/ac72dbcc45224612b5ee124a82f4d2a3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.158354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] RBAC: Authorizing `identity:get_user(user_id=ac72dbcc45224612b5ee124a82f4d2a3)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.159790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.165451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 149/305] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/users/ac72dbcc45224612b5ee124a82f4d2a3 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.167764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.197710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.198708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.199175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.199719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.211276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:15.216961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:15.217967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:15.218751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:15.221267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 157/306] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:15.222278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.272715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b828980-f457-4598-91ca-f304fb25afde None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.315207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.315207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.315207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.315825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.332036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00403cf5-5429-4993-9e55-8ea77bb3017f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.334499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.345472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.369229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.369907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.370182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.370451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.380848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:15.385653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:15.386637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:15.387544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:15.388141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.388211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 158/307] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:15.388211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.388337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.486637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 150/308] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 02:07:15.487386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.489090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3d4b1-404d-411c-bbf0-eb839d161ce6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.522471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.523091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.523361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.523622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.524275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:15.524573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.526431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.534248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 159/309] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.535136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.548805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.562254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.592018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132b538-65e2-4b2d-a9d3-cb3c2546f0a1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.627796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.628449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.628710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.628983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.630127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.631579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.633159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 151/310] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.633946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.641927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda59af-9739-48c4-aeee-3718d9cf7831 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.676640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.677250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.677558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.677833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.678496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:15.678777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.680170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.688357 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 160/311] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.689133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.732549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1df42-d5a8-4078-812e-4b62fe0c923a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.758867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.767610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.768248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.768519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.768819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.769945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.771400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.773026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 152/312] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.773886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.781483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:15.793521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea127f-fb58-43cc-b87f-a42830abf063 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.827262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.827886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.828167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.828440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] PATH_INFO: `/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.829669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] RBAC: Authorizing `identity:get_user(user_id=94d0b4e94bbe4d64a5ab10b9dc0e33a3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.831117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.832687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 161/313] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:15.833438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.879313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09385-1c2f-497d-8599-9f69823f83f5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.913528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.914134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.914413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.914688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] PATH_INFO: `/v3/groups` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.915314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.916791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.931211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e3679-64b2-4cec-9066-9cee37c9129c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:15.932816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 153/314] 10.222.0.61 () {60 vars in 1134 bytes} [Sat Aug 27 02:07:15 2022] POST /identity/v3/groups => generated 229 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:15.933444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:15.977921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:15.978827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:15.979180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:15.979520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] PATH_INFO: `/v3/users/af88df4f97354a06bfe78612bba89f89` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:15.995433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] RBAC: Authorizing `identity:get_user(user_id=af88df4f97354a06bfe78612bba89f89)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:15.997070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:15.998936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 162/315] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/users/af88df4f97354a06bfe78612bba89f89 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:16.005205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:16.018968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:16.020708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:16.069868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b8bd9-157b-4df7-a40c-5234eb3e5fc7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:16.106426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:16.107040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:16.107312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:16.107624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:16.108364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, scope.project.id=b110753e43f8454597a752d36cf04107, user.id=ac72dbcc45224612b5ee124a82f4d2a3) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:16.109581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:16.110147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:16.117010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 154/316] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:15 2022] GET /identity/v3/role_assignments?user.id=ac72dbcc45224612b5ee124a82f4d2a3&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=d86c43353dfb47da842c631531e8864f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:16.118050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:16.133695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b342-c950-45d1-8fc5-f2580872b6ac None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:16.178146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:16.178993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:16.179369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:16.179748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] PATH_INFO: `/v3/system/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:16.182316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=94d0b4e94bbe4d64a5ab10b9dc0e33a3, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:16.184495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf6c3c-9066-4807-bb91-e8d74d0a501a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:16.197090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 163/317] 10.222.0.61 () {58 vars in 1334 bytes} [Sat Aug 27 02:07:15 2022] PUT /identity/v3/system/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:16.246139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f618b88-6b9f-4f68-a223-0a30986d1edc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:16.268687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:16.290880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:16.291489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:16.291772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:16.292048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:16.292794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, user.id=af88df4f97354a06bfe78612bba89f89, scope.system=all) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:16.293104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:16.294667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7825002-330f-4d78-919e-dd95522d557d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:16.300788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 155/318] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Aug 27 02:07:16 2022] GET /identity/v3/role_assignments?user.id=af88df4f97354a06bfe78612bba89f89&scope.system=all&role.id=d86c43353dfb47da842c631531e8864f => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:17.855430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4312-b683-443d-996a-c8754e67b73c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:17.855968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4312-b683-443d-996a-c8754e67b73c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:17.855968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b4312-b683-443d-996a-c8754e67b73c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:17.857504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 164/319] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:17.862679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac5788-5e8d-4088-adb9-1741a20f9fdb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:17.863111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac5788-5e8d-4088-adb9-1741a20f9fdb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:17.863183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac5788-5e8d-4088-adb9-1741a20f9fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:17.881313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3dac5788-5e8d-4088-adb9-1741a20f9fdb None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:17.882521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3dac5788-5e8d-4088-adb9-1741a20f9fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:17.952067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 156/320] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:18.124109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7554-db5b-4c2a-be64-bd8d0a8bbd66 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.124298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7554-db5b-4c2a-be64-bd8d0a8bbd66 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.124573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e7554-db5b-4c2a-be64-bd8d0a8bbd66 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.126100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 165/321] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:18.131289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abef36-99c8-4d8b-a7c9-fecbdbb67ff2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.131572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abef36-99c8-4d8b-a7c9-fecbdbb67ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.131844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abef36-99c8-4d8b-a7c9-fecbdbb67ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.149899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-34abef36-99c8-4d8b-a7c9-fecbdbb67ff2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:18.151414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-34abef36-99c8-4d8b-a7c9-fecbdbb67ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:18.214516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e7554-db5b-4c2a-be64-bd8d0a8bbd66 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.220674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 157/322] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:18.245808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2aa1-da59-4b39-ab86-86acc0e50c35 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.246107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2aa1-da59-4b39-ab86-86acc0e50c35 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.246374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2aa1-da59-4b39-ab86-86acc0e50c35 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.247688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 158/323] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:07:18.252257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.252539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.252811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.270472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:18.271637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:18.300521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.318865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.331517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e7554-db5b-4c2a-be64-bd8d0a8bbd66 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.350409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 159/324] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:18.370317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.370944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.371217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.371479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.372543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:18.374018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:18.375857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 166/325] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:18.381361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.479768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.485892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee70c78-9ae4-4b67-b98e-eda80e9f3fa9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.520824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.521452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.521734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.522003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] PATH_INFO: `/v3/groups` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.522642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:18.524061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:18.549435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 160/326] 10.222.0.61 () {60 vars in 1134 bytes} [Sat Aug 27 02:07:18 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:18.588807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79564e16-ad06-4c00-8e4d-86125f5bb032 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.611686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.627391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.627948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.628202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.628508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.640269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:18.645707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:18.646712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:18.647524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 167/327] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:18.652615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.653212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.664084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.745748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980ec1b-6d71-4510-bcee-da6bafdd51a4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.776162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5c3a5-3324-450d-856e-a20289625a75 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.789054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.789740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.790019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.790289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.806277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:18.813050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:18.813990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:18.814773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 161/328] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:18.821778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.824895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.825559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.825923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.826199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.826881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:18.827199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:18.828592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:18.837575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 168/329] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:18.843519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:18.934411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.934893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:18.944634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0431d-434a-4b4d-8269-9a2898096515 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.985114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53920c-2e52-4107-a9c5-3e4d0c6516c1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:18.992511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:18.993530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:18.994014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:18.994342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:18.995020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:18.995321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:18.996712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:19.009594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 162/330] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:19.013347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:19.024503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:19.025153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:19.025825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:19.026097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] PATH_INFO: `/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:19.027284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] RBAC: Authorizing `identity:get_user(user_id=94d0b4e94bbe4d64a5ab10b9dc0e33a3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:19.028772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:19.030599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 169/331] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:18 2022] GET /identity/v3/users/94d0b4e94bbe4d64a5ab10b9dc0e33a3 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:19.041286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:19.137141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284cf0b-a5e0-4629-819e-eebffc6efcf3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:19.147992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0a5a8-17ef-45f8-9677-4986762938f2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:19.173936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:19.174960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:19.175506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:19.175994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] PATH_INFO: `/v3/users/af88df4f97354a06bfe78612bba89f89` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:19.177331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] RBAC: Authorizing `identity:get_user(user_id=af88df4f97354a06bfe78612bba89f89)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:19.179127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:19.181775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 163/332] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:19 2022] GET /identity/v3/users/af88df4f97354a06bfe78612bba89f89 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:19.187858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:19.188707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:19.189578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:19.190047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:19.190835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:19.192933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] RBAC: Adding query filter params (role.id=0fb732effc6f492c9a998d105764e845, user.id=94d0b4e94bbe4d64a5ab10b9dc0e33a3, scope.system=all) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:19.193521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:19.195181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684f62-cffb-4087-9b36-3ed2591429ba None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:19.199256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:19.217517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 170/333] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Aug 27 02:07:19 2022] GET /identity/v3/role_assignments?user.id=94d0b4e94bbe4d64a5ab10b9dc0e33a3&scope.system=all&role.id=0fb732effc6f492c9a998d105764e845 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:19.224213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:19.312549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cc633-b451-48c3-9bfd-a206c5f908c1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:19.350631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:19.351335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:19.351617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:19.351893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] PATH_INFO: `/v3/system/users/af88df4f97354a06bfe78612bba89f89/roles/d86c43353dfb47da842c631531e8864f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:19.353570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af88df4f97354a06bfe78612bba89f89, role_id=d86c43353dfb47da842c631531e8864f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:19.354982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0337a3e2-e12e-48e6-9de9-1a5f0a7f5dab None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:19.369359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 164/334] 10.222.0.61 () {58 vars in 1334 bytes} [Sat Aug 27 02:07:19 2022] PUT /identity/v3/system/users/af88df4f97354a06bfe78612bba89f89/roles/d86c43353dfb47da842c631531e8864f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:07:20.747053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d883-6f5d-48a7-badd-ccc3395d2f05 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:20.747557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d883-6f5d-48a7-badd-ccc3395d2f05 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:20.747631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61d883-6f5d-48a7-badd-ccc3395d2f05 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:20.749249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 171/335] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:20.754199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf17b5-d12d-41b8-8f75-1408e58ed910 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:20.754610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf17b5-d12d-41b8-8f75-1408e58ed910 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:20.754803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf17b5-d12d-41b8-8f75-1408e58ed910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:20.777219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e0cf17b5-d12d-41b8-8f75-1408e58ed910 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:20.778469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e0cf17b5-d12d-41b8-8f75-1408e58ed910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:20.864136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 165/336] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:20.870430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa2ca6-bb24-4f86-a83a-e972b28f258b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:20.870716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa2ca6-bb24-4f86-a83a-e972b28f258b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:20.870977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa2ca6-bb24-4f86-a83a-e972b28f258b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:20.872309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 172/337] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:20.878804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee12b5-1733-4fdf-9df4-dbc5b02942a2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:20.879086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee12b5-1733-4fdf-9df4-dbc5b02942a2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:20.879360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee12b5-1733-4fdf-9df4-dbc5b02942a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:20.902175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-03ee12b5-1733-4fdf-9df4-dbc5b02942a2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:20.903387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-03ee12b5-1733-4fdf-9df4-dbc5b02942a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:20.915296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:20.977557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 166/338] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:21.375386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa2ca6-bb24-4f86-a83a-e972b28f258b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:21.522016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa2ca6-bb24-4f86-a83a-e972b28f258b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:21.562684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:21.563235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.563507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.563779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.579716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:21.585323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:21.586237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:21.587011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 173/339] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:21.592183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2076-12db-4304-8cf5-8dab77908dca None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.592402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:21.592500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2076-12db-4304-8cf5-8dab77908dca None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.592719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c2076-12db-4304-8cf5-8dab77908dca None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.594391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 167/340] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:21.599839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.600117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.600386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.628665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:21.631281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:21.714849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:21.729169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 168/341] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:21.730481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:21.807551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7e4e-da86-45df-b7fe-3da46e205b9f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:21.824820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:21.850348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bf0d-0e64-4591-95ca-473a456746a0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:21.886950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:21.887931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.888403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.888862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.899728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-87cc120e-a578-4535-9fb5-f0945b22578a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:21.905285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:21.906286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:21.907081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:21.907673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:21.907673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.907673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.907673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.907941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:21.908517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:21.909707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:21.910363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 169/342] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:21.911761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687b37-011e-4aa8-8314-4d170ba06512 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.912239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687b37-011e-4aa8-8314-4d170ba06512 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.912711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f687b37-011e-4aa8-8314-4d170ba06512 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.914430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 170/343] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:21.920301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:21.920829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:21.921339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:21.927540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 174/344] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:21.928374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:21.942356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:21.943942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:22.016503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 171/345] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:22.017833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.123912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.126217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92095a-1557-4232-b83d-b179865e7a4b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.133513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de51d80-dc06-4c49-8dd2-a985f002d872 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.153947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.171199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.171976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.172355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.172719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.174758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.175802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.176261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.176693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.177564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:22.178054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.179628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.190431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 175/346] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:22.191856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.255952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.258792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.302793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b50c26-9c1b-464f-b536-abea16ff6017 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.343765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.344703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.345171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.345631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.357802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:22.363510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:22.364625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 27 02:07:22.365485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:22.366110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.366181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 176/347] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:22.366925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.383769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 172/348] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:22.385172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.415510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.480703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cf454-6ab9-4cc4-8dd3-5c94ceff67e7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.513178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7b3e6-54c9-46cf-a5c6-e2277e64d3dd None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.516811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.517585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.517930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.518260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.559366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.560369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.560939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.561386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.562446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:22.562998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.564627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.575218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 173/349] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:22.576429 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.604780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.606332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.611954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.651996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.707333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99ae82-e5bf-4508-a349-a43ec88da096 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.724852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 177/350] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:22.726808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.747542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.748535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.749030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.749524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.765948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:22.771037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:22.771972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:22.772764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 174/351] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:22.773472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.876857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d43d9-1e70-4862-96ab-7132da0ee6a4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.909070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.922546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c1bd7-329e-407d-b5fb-b4d72c4ab971 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:22.926139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.929009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.929009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.929009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.929009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.931228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.931852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 178/352] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:22.933614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:22.945736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:22.968566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:22.969207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:22.969568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:22.969839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] PATH_INFO: `/v3/users/af88df4f97354a06bfe78612bba89f89` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:22.971115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] RBAC: Authorizing `identity:get_user(user_id=af88df4f97354a06bfe78612bba89f89)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:22.972722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:22.976207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 175/353] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/users/af88df4f97354a06bfe78612bba89f89 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:22.976207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.056968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89463723-50ae-4a39-99e5-6993d576d091 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.098021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.098810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.099185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.099548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.101317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.102859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ff97d-5ad9-4ce5-b4ae-3b845247aaa4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.104580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 179/354] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.105761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768420e5-e5c2-4b88-a307-ca0658f1012b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.106038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768420e5-e5c2-4b88-a307-ca0658f1012b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.106310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768420e5-e5c2-4b88-a307-ca0658f1012b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.107639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 180/355] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:23.111075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768420e5-e5c2-4b88-a307-ca0658f1012b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.114977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90c61-dc42-4e13-a87b-43b99c379898 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.165285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.166223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.166505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.166779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.167458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:23.167766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.169334 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.180197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 176/356] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.180881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.201628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.208122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.244889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768420e5-e5c2-4b88-a307-ca0658f1012b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.289486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.290492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.291069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.292484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.300708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.302498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.309519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 181/357] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.310413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.318947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b176-8932-4d5d-823f-fc44cdad685d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.363615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.364255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.364550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.364800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.365571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] RBAC: Adding query filter params (role.id=d86c43353dfb47da842c631531e8864f, user.id=af88df4f97354a06bfe78612bba89f89, scope.system=all) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:23.365876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.367306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3045e15c-f604-4f3a-92f7-e7f400529def None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.385981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 177/358] 10.222.0.61 () {56 vars in 1308 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/role_assignments?user.id=af88df4f97354a06bfe78612bba89f89&scope.system=all&role.id=d86c43353dfb47da842c631531e8864f => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.393213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.393213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.393213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.410274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:23.411474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:23.458264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770f7f8-d206-4627-a033-5542ba23a346 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.506395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.507516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.508074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.508592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.509846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 178/359] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:23.510202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.510916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.517424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.520967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 182/360] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.521150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.530093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.540911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.647479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b932b5-6ec9-4c37-8b10-ee434a00f607 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.650174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5b0c-8483-46b3-852e-1cc5458d8968 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.685123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.685772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.686050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.686317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.688870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.689512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.689887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.690162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.690965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=1019d4ac665d428c8fe31e8f29838af6) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:23.691275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.692817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.700207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 183/361] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=0fb732effc6f492c9a998d105764e845 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.701167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.768959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.770956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823dc88-6ed9-409c-ae04-b1f2eec32622 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.783279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.804644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:23.840852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f91f3-ee2d-469e-a413-b6bdeceeb3ee None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:23.883735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:23.885080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.886063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.886063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.886383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=c388505e96244703b71034784851f8f0, scope.project.id=1019d4ac665d428c8fe31e8f29838af6) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:23.886818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:23.888136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:23.896725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 179/362] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:23.898478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304e067-5bb3-41cd-a57c-b86b8e5b00e4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:23.898764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304e067-5bb3-41cd-a57c-b86b8e5b00e4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:23.899041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304e067-5bb3-41cd-a57c-b86b8e5b00e4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:23.899649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 184/363] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=c388505e96244703b71034784851f8f0 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:23.900918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:23.901104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 180/364] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:23.902187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304e067-5bb3-41cd-a57c-b86b8e5b00e4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.019163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304e067-5bb3-41cd-a57c-b86b8e5b00e4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.023334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01c5dc-7511-44ac-9c79-7b42f862442f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.034193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:24.059561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.060301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.060582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.060852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.062171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:24.063829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b58622-d62b-4003-8f3a-331a7002f53b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:24.064760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.065421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.065732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.065898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 181/365] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:24.067081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.067357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.067623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.069698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.073699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:24.084579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:24.089564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:24.089991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:24.090841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:24.091643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:24.092249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:24.092325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 185/366] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:24.093014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.199363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 182/367] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:24.200235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.222402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a69cf-8515-4deb-b608-d5e86e4425ca None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.296105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.299622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.301199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.301697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.303305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:24.306092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:24.309610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 186/368] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:24.319515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.388721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:24.403545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9026d94a-7360-4a4d-a32f-a0215f515120 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.410414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:24.439418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59a9d-9f41-4d98-98c4-1440a9123936 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.479217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.480257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.480834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.481267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.482272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=b110753e43f8454597a752d36cf04107) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:24.482737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:24.482853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.483557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.485516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.485516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.485516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:24.485516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:24.486599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:24.486844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:24.497100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 187/369] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=0fb732effc6f492c9a998d105764e845 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:24.512235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 183/370] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:24.517741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.578993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.685917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d7ee6-f451-4ade-ba81-c9ddabc804a4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.737589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:24.753237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.753882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.754154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.754421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.770531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4117df-34aa-45e7-9c50-ef8fafb1a5f2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:24.839009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:24.839580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:24.839925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:24.840196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:24.862682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:24.880331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:24.881324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:24.882271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 184/371] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:24.885319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:24.889429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:24.908233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:24.957772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.047028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a981d1-e78d-40a9-8065-b1807973f097 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.086473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.087096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.087372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.087669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.088374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:25.088675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.090138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.099922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 185/372] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:25.106102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.180296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 188/373] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:25.186348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.205824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.220421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e3abd-768f-4e12-8b01-94eda2d465fb None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.257894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.258518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.258794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.259061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.269795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.330667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.331510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.363588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2752ba-5ccc-4623-b597-309640ca828e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.401748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.402658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.403082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.403495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.405802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.407475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.410336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 189/374] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:25.416102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.429780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.443184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 186/375] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:25.451644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.561682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a0801-a1ca-4f0d-a29c-73171dde2d1a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.600552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.601584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.602059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.602530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] PATH_INFO: `/v3/projects/6316912820d4459d94f37567f9470b42` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.603845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] RBAC: Authorizing `identity:get_project(project_id=6316912820d4459d94f37567f9470b42)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.606979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.609270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 187/376] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/projects/6316912820d4459d94f37567f9470b42 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:25.617491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.683122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3bbbb-facd-4ad2-ba52-506d590a1a87 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.718717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.724159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.726350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.726778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.727587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.730010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.732040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.734318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 190/377] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:25.742401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.781758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:25.840498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031ca7b-c2f7-4f0a-a100-7b9eaa62f562 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.882537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.883108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.883382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.883648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] PATH_INFO: `/v3/groups/f2be872f40d045b79a68fe4c8531dff4` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.894318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] RBAC: Authorizing `identity:get_group(group_id=f2be872f40d045b79a68fe4c8531dff4)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.895788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.901604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3ce57-04e4-420f-b639-b2055321b983 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:25.903725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 188/378] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/groups/f2be872f40d045b79a68fe4c8531dff4 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:25.909723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:25.965535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:25.966148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:25.966419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:25.966685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:25.967416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=c388505e96244703b71034784851f8f0, scope.project.id=b110753e43f8454597a752d36cf04107) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:25.967716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:25.969163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc538d-92a8-46bf-aa26-399de3b26d08 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:25.982945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 191/379] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=c388505e96244703b71034784851f8f0 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:26.046581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4c44e-7601-49a4-aaef-a9d7f5d0dd7d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:26.078019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:26.094455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:26.095085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.095367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.095643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.096395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] RBAC: Adding query filter params (group.id=f2be872f40d045b79a68fe4c8531dff4, role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=6316912820d4459d94f37567f9470b42) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:26.096703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:26.098190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76eab76-cd6f-4602-9920-fc07a3a518b0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:26.110371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 189/380] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:25 2022] GET /identity/v3/role_assignments?group.id=f2be872f40d045b79a68fe4c8531dff4&scope.project.id=6316912820d4459d94f37567f9470b42&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:26.117084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5ebc-0bcc-40cb-82f6-9f17d16ebb0a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.117480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5ebc-0bcc-40cb-82f6-9f17d16ebb0a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.117740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5ebc-0bcc-40cb-82f6-9f17d16ebb0a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.119234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 192/381] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:26.127613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f03ec-aea3-442c-a0bd-14967a9a0a92 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.128014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f03ec-aea3-442c-a0bd-14967a9a0a92 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.128192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f03ec-aea3-442c-a0bd-14967a9a0a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.148560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e87f03ec-aea3-442c-a0bd-14967a9a0a92 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:26.149741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e87f03ec-aea3-442c-a0bd-14967a9a0a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:26.233019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 190/382] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:26.378503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644722-d952-466d-81b8-0f2a6d547c8a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.379150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644722-d952-466d-81b8-0f2a6d547c8a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.379606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55644722-d952-466d-81b8-0f2a6d547c8a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.381370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 193/383] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:26.386589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.386928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.387210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.410646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:26.411776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:26.490260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 191/384] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:26.593693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644722-d952-466d-81b8-0f2a6d547c8a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:26.632681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:26.729074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55644722-d952-466d-81b8-0f2a6d547c8a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:26.770214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:26.771231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.771697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.772178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.786467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:26.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:26.793048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:26.793864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:26.796453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 194/385] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:26.802518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:26.827360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:26.860671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:26.921210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6148a2c8-fcce-4909-be55-26ab081ab248 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:26.960739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:26.961359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.961665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.961932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.962639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] RBAC: Adding query filter params (name=member) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:26.962945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:26.964316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b6bc8-69d2-4d04-a8de-cc78ebf4504a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:26.975595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:26.979950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 192/386] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:26.981166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8df5-1e3d-4eb3-9202-55879ac40509 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:26.981478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8df5-1e3d-4eb3-9202-55879ac40509 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:26.981752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e8df5-1e3d-4eb3-9202-55879ac40509 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:26.982947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 193/387] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:26.988660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e8df5-1e3d-4eb3-9202-55879ac40509 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.004286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db42c-5a18-4808-bb25-7ed73520bec0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.050577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.051444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.051724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.051992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.066731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-2741fbd0-b88b-4b99-b9cb-447312b4de24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:27.072409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:27.073276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:27.074114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 195/388] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:27.078282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.078563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.078836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.106669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:27.107872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:27.129778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e8df5-1e3d-4eb3-9202-55879ac40509 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.137566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:27.169221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.169973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.170388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.170661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.171800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.173466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.175668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 194/389] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:26 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:27.176607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.181837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 196/390] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:27.182678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.292534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09706d93-7d99-42cf-b57a-14ba449037ae None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.302084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:27.342114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.343074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.343074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.343371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.344085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:27.344390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.345785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.347242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5a4ce-0774-4a84-9b12-5ea62ab07d90 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.360664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 195/391] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:27.366612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.386168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.386805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.387082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.387353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.388478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.389959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.391583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 197/392] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:27.397652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.438165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:27.527832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bbb6f-8d93-4c48-8762-57fe515fdf92 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.535867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650d852-9750-4342-ba21-6c134a1148d4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.563706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.564585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.565046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.565538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.566871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.568522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.572710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 196/393] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:27.573385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.574095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.574378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.574650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/groups/e8745e0a9bc14975ac8366913dc06353/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.576710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, group_id=e8745e0a9bc14975ac8366913dc06353, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.577963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.578479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.595420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 198/394] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Aug 27 02:07:27 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/groups/e8745e0a9bc14975ac8366913dc06353/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:27.706145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c854f-d14c-4796-9e4e-6bddf0c9ef1d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.709025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:27.746953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.747615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.747885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.748157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.749458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.750961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.753110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 197/395] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:27.758809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.763163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:27.781029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:27.879908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb34b8-ff24-46ac-87fd-563bf2eff59a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.890436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095b30c-0a14-415c-b8a2-030c6649dc8a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:27.918838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.919598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.919921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.920199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6/groups/e8745e0a9bc14975ac8366913dc06353/roles/c388505e96244703b71034784851f8f0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.922592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1019d4ac665d428c8fe31e8f29838af6, group_id=e8745e0a9bc14975ac8366913dc06353, role_id=c388505e96244703b71034784851f8f0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:27.924045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:27.937034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:27.938880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:27.939168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:27.939442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:27.941609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 199/396] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Aug 27 02:07:27 2022] PUT /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6/groups/e8745e0a9bc14975ac8366913dc06353/roles/c388505e96244703b71034784851f8f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:27.953942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:27.960686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:27.961677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:27.962467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 198/397] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:27.968679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:28.037305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:28.094684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df28ba-2a6b-4269-8d48-06fac17c36a1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:28.149285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:28.149866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.150193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.150775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.151460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:28.151759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:28.153251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:28.163353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 200/398] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:28.169258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:28.205105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:28.282809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fef84c-aa8a-4de8-b7c6-5d3689436094 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:28.320823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:28.321501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.321786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.322116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.325524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:28.327092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:28.329183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 199/399] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:28 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:28.334577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:28.445948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf84ad2-bc75-48b7-be42-51bfbbc7a40f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:28.473746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:28.483390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:28.484035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.484310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.484581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.485785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:28.487247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c51214-b743-4279-acee-d8148dde71fe None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:28.489260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 201/400] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:28 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:28.494956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:28.609887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:28.618346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42138f-1dab-4b60-9626-6615bc2c90c8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:28.625481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1c5d-7982-43b2-95b0-d9c6e9415796 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.626057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1c5d-7982-43b2-95b0-d9c6e9415796 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.626518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1c5d-7982-43b2-95b0-d9c6e9415796 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.628904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 202/401] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:28.633909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78e89-00f6-4b14-9153-8615f4affc8f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.634527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78e89-00f6-4b14-9153-8615f4affc8f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.634991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78e89-00f6-4b14-9153-8615f4affc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.659781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d1d78e89-00f6-4b14-9153-8615f4affc8f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:28.661379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d1d78e89-00f6-4b14-9153-8615f4affc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:28.684740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:28.685919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.685919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.686082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/groups/e8745e0a9bc14975ac8366913dc06353/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.687859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, group_id=e8745e0a9bc14975ac8366913dc06353, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:28.689509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccba5a-1b32-4c86-8d23-156b559a0ebe None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:28.716563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 200/402] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Aug 27 02:07:28 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/groups/e8745e0a9bc14975ac8366913dc06353/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:28.742186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 203/403] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:28.822460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a382f5-1911-45e7-aeb7-31d2fefcac52 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.822789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a382f5-1911-45e7-aeb7-31d2fefcac52 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.823014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a382f5-1911-45e7-aeb7-31d2fefcac52 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.824551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 201/404] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:28.830312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:28.830830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:28.831310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:28.858766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:28.860362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:28.957491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 204/405] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:29.031796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a382f5-1911-45e7-aeb7-31d2fefcac52 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.148748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a382f5-1911-45e7-aeb7-31d2fefcac52 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.188671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.189308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.189615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.189889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.208535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:29.213471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:29.214342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:29.215130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 202/406] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:29.220312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.333907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:29.339012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.384006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:29.385024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc8424-14a5-46ed-ae4b-f10fb1440732 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.445009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.445669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.445942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.446207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.446963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:29.447261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:29.448624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:29.452987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324709c5-f6ee-489e-987d-4f25ac28af70 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.466912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 205/407] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:29.472320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.490516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.491363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.491874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.492240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.507604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:29.515610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:29.516555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:29.517339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 203/408] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:29.533684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.581212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8bbfd-2766-4994-bd8b-7c50a811d1fa None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.597588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:29.643105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.643755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.644031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.644297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] PATH_INFO: `/v3/groups/f2be872f40d045b79a68fe4c8531dff4` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.645449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] RBAC: Authorizing `identity:get_group(group_id=f2be872f40d045b79a68fe4c8531dff4)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:29.646903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:29.648777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 206/409] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/groups/f2be872f40d045b79a68fe4c8531dff4 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:29.654434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.655054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:29.683355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323c6e-8925-4206-ad53-080309db0406 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.767633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.768663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.769159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.769662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.770563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:29.771052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:29.771150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f2f9a-f5e1-491e-832c-ada9d7f65177 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.772737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:29.792413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 204/410] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:29.798061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.805173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.805833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.806107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.806418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] PATH_INFO: `/v3/projects/6316912820d4459d94f37567f9470b42` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.807527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] RBAC: Authorizing `identity:get_project(project_id=6316912820d4459d94f37567f9470b42)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:29.808973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:29.810917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 207/411] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/projects/6316912820d4459d94f37567f9470b42 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:29.816458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:29.877835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:29.916273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feca35-8546-4b17-b8c1-c1c7bbf93a64 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:29.950239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:29.950917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:29.951177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:29.951447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] PATH_INFO: `/v3/projects/6316912820d4459d94f37567f9470b42/groups/f2be872f40d045b79a68fe4c8531dff4/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:29.953319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] RBAC: Authorizing `identity:create_grant(project_id=6316912820d4459d94f37567f9470b42, group_id=f2be872f40d045b79a68fe4c8531dff4, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:29.954842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:29.978635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 208/412] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Aug 27 02:07:29 2022] PUT /identity/v3/projects/6316912820d4459d94f37567f9470b42/groups/f2be872f40d045b79a68fe4c8531dff4/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:29.998413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6e48-f5ac-4dae-a080-70ca759c84f2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:30.044457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:30.045098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.045435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.045714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.047478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:30.049005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d8cd09-e093-44dc-be04-47a46e2f03e8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:30.051089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 205/413] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:29 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:30.056861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:30.059265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b335-8513-4fee-99e8-156f26172cc3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.059545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b335-8513-4fee-99e8-156f26172cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.060177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b335-8513-4fee-99e8-156f26172cc3 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.061588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 206/414] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:30.068463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.068775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.069012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.096659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:30.097854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:30.108458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:30.230309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d4d36-bfd1-446c-8077-ebde198d5088 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:30.232410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 207/415] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:30.249711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:30.277329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:30.278483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.279076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.279640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.281149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:30.283343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:30.286207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 209/416] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:30 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:30.292995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:30.414939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff66780-144c-4bfe-9e81-30b45596ca6a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:30.452726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:30.453419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.453707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.453981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107/groups/e8745e0a9bc14975ac8366913dc06353/roles/c388505e96244703b71034784851f8f0` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.456090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] RBAC: Authorizing `identity:create_grant(project_id=b110753e43f8454597a752d36cf04107, group_id=e8745e0a9bc14975ac8366913dc06353, role_id=c388505e96244703b71034784851f8f0)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:30.457555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe654f-77f6-4012-a892-e855b3e05145 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:30.470390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:30.474891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 208/417] 10.222.0.61 () {58 vars in 1442 bytes} [Sat Aug 27 02:07:30 2022] PUT /identity/v3/projects/b110753e43f8454597a752d36cf04107/groups/e8745e0a9bc14975ac8366913dc06353/roles/c388505e96244703b71034784851f8f0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:30.514365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:30.643210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cfab3-dc08-4573-ad21-964706c76bcc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:30.686520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79596-d8b6-498b-b79e-34d4b9e70ba9 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.686846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79596-d8b6-498b-b79e-34d4b9e70ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.687077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79596-d8b6-498b-b79e-34d4b9e70ba9 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.688705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 209/418] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:30.693856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:30.694522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.694655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.694819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.694930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.695132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.695248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.714461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:30.715671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:30.720493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:30.726207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:30.727156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:30.727988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 210/419] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:30.733562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:30.797934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:30.829254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 210/420] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:30.865263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eccf-dac2-4060-b60c-365d8e0f3418 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:30.902253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:30.903173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:30.903629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:30.904074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:30.904934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:30.905539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:30.907103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:30.920284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 211/421] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:30.926237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.041615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005831d-8263-4fc9-b99b-9559c48c2031 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.070837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.082399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.083024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.083314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.083585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.159631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:31.161103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:31.200074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.329521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 211/422] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:31.336501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.353502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404d332-3179-4212-8aea-6670f1867a68 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.356161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.366948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.404290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.404926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.405204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.405514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.417936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-41cb473b-e103-4453-b420-aaec644b8c2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:31.424157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:31.425079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:31.425918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 212/423] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:31.429050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d8ce-4c67-48f1-9bf5-db597b0c8c02 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.429050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d8ce-4c67-48f1-9bf5-db597b0c8c02 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.429050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9d8ce-4c67-48f1-9bf5-db597b0c8c02 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.429280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 213/424] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:31.431848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9d8ce-4c67-48f1-9bf5-db597b0c8c02 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.452295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479e015-f0db-4bcb-ab1d-32b0309c8e6a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.500240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.500888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.501165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.501601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.502742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:31.504199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279630d-40a9-4d66-bdc3-e0acee2955a2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:31.506518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 212/425] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:31.508409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.508649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.508926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.533191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:31.534868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:31.572983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9d8ce-4c67-48f1-9bf5-db597b0c8c02 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.620130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.620130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.620130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.620130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.620500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:31.620500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:31.620500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:31.621020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 213/426] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:31.622097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.628055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 214/427] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:31.634185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.665730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.679353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.759396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4c2b6-78dc-4493-9332-a235318680ee None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.798361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.798970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.799244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.799509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.812712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0d3be-4a30-4730-8f1a-163b3f7db479 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:31.881898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:31.883839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:31.907055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:31.907716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:31.907999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:31.908269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:31.909386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:31.910910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:31.917743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:31.921267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 214/428] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:31.922194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:31.996059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 215/429] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:31.996946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.074821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.081814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f43ad4-0226-4090-9741-f60295fb69b7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.116304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.116917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.117198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.117507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.118239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=1019d4ac665d428c8fe31e8f29838af6) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:32.118549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.120065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.131228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f2566-1e3c-468e-ade1-7bac2577ec37 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.133740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 215/430] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=0fb732effc6f492c9a998d105764e845 => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:32.134802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.161495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.176504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.177147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.177445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.177721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.190490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:32.196051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:32.197025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:32.197843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 216/431] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:32.206742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.353575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfef9-b8fe-43ae-8b2c-33927d86d56f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.394001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7869d-9154-4c9b-b7e4-c418e7969371 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.395306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.395955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.396238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.396517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] PATH_INFO: `/v3/projects/1019d4ac665d428c8fe31e8f29838af6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.400919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] RBAC: Authorizing `identity:get_project(project_id=1019d4ac665d428c8fe31e8f29838af6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.400919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802f40f1-f848-4e16-b57e-71645429068b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.401583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 216/432] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/projects/1019d4ac665d428c8fe31e8f29838af6 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:32.402757 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8148ef-9d4e-4c94-b59c-97c9914f7c9c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.403038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8148ef-9d4e-4c94-b59c-97c9914f7c9c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.403309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8148ef-9d4e-4c94-b59c-97c9914f7c9c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.404506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 217/433] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:32.409808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8148ef-9d4e-4c94-b59c-97c9914f7c9c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.444195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.445125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.445995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.446218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.446492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.448365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:32.448680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.451496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091ddb-c97f-4e06-8686-d108c350b0a4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.460623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 217/434] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:32.461943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.462289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.462629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.484091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:32.485297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:32.532911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8148ef-9d4e-4c94-b59c-97c9914f7c9c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.540803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.569725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 218/435] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:32.570944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.580100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.580743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.581236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.581548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.584568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.586148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.587929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 218/436] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:32.595663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.717469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b393454-c95a-4e75-8537-34b8f68e642f None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.724446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.732383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36479b29-1e0f-4e6e-a081-b648c04137c9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:32.765833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.767109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.767589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.768186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.778002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:32.778618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.778886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.779177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.779885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=c388505e96244703b71034784851f8f0, scope.project.id=1019d4ac665d428c8fe31e8f29838af6) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:32.780189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.781654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.788508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 219/437] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=1019d4ac665d428c8fe31e8f29838af6&role.id=c388505e96244703b71034784851f8f0 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:32.825791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:32.852743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:32.854934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77091a3-b357-4ce9-833f-95a8c3e0fe22 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:32.891230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:32.981281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 219/438] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:32.982558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc537-d5a5-4372-b72f-5a6c6fc93a29 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:32.982843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc537-d5a5-4372-b72f-5a6c6fc93a29 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:32.983117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dc537-d5a5-4372-b72f-5a6c6fc93a29 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:32.984627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 220/439] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:32.988796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dc537-d5a5-4372-b72f-5a6c6fc93a29 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.008912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6402de-afc0-4216-b08b-ea8e834ceea2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.050126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.050787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.051065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.051335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.063382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3374e794-5ea5-42de-b9de-bdbec1d32a61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:33.068263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:33.069152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:33.069982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 220/440] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:33.070913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.071199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.071479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.079603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.091944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:33.093124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:33.106857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dc537-d5a5-4372-b72f-5a6c6fc93a29 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.108811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.149385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.150136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.150773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.151042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.152481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.154234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.156280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 221/441] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:32 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:33.157162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.171096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 221/442] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:33.171949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.281131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166453a4-5f77-4838-9e03-5fa1e239b249 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.288341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d999014-c1d1-492d-9289-54cdc6da071a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.320415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.321062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.321340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.321639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.322992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.324436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.330961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 222/443] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:33.331982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.335254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.336737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.337011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.337276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.338057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:33.338355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.339703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.350102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 222/444] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:33.356452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.357583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.366314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.445197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d057d7-80a7-4638-9d9e-2cbb308dc7a9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.471806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18cdad5-1d1a-4373-b6d5-c6d4688bd126 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.479906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.480516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.480796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.481068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.481827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=0fb732effc6f492c9a998d105764e845, scope.project.id=b110753e43f8454597a752d36cf04107) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:33.482137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.483583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.489276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 223/445] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=0fb732effc6f492c9a998d105764e845 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:33.490063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.508240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.508860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.509136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.509531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.596372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.597879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.600668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.608358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.626373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48238c8a-6d29-4456-9bbd-ed09a5c25f63 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.668835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.669829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.670296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.670580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.681133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:33.686473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:33.687378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:33.688178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 224/446] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:33.695063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.729425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 223/447] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 02:07:33.730861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.813285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bfca55-4b92-4691-b166-14bb5677aae2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.847364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547dad-8cc1-4a29-99b8-40fd9f7ae874 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.851285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.851924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.852203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.852476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.853165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:33.853494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.854709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.854884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.863138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 225/448] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:33.868705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.872169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:33.886539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:33.887157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:33.887433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:33.887703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] PATH_INFO: `/v3/projects/6316912820d4459d94f37567f9470b42` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:33.888830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] RBAC: Authorizing `identity:get_project(project_id=6316912820d4459d94f37567f9470b42)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:33.890309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:33.891927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 224/449] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/projects/6316912820d4459d94f37567f9470b42 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:33.897243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:33.967898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e8c6-2854-4f5a-9e5c-a70bf5c377cf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:33.998950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844dc80-c8c7-40fa-a631-ed81d1653538 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:34.003005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.003609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.003886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.004150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.036139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.036750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.037028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.037299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] PATH_INFO: `/v3/groups/f2be872f40d045b79a68fe4c8531dff4` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.038462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] RBAC: Authorizing `identity:get_group(group_id=f2be872f40d045b79a68fe4c8531dff4)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.039906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.041543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 225/450] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/groups/f2be872f40d045b79a68fe4c8531dff4 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:34.048461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:34.073123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.074821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.077356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:34.092510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:34.148861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f37fb7-7314-448a-9321-87e0e0d681d4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:34.179817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 226/451] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 02:07:34.181099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:34.185919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.186597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.186857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.187127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.187863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] RBAC: Adding query filter params (group.id=f2be872f40d045b79a68fe4c8531dff4, role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=6316912820d4459d94f37567f9470b42) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:34.188172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.189605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.195620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 226/452] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:34 2022] GET /identity/v3/role_assignments?group.id=f2be872f40d045b79a68fe4c8531dff4&scope.project.id=6316912820d4459d94f37567f9470b42&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:34.294935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741042e-f203-4fed-85e3-dfc87e66ff6e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:34.297538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:34.333824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.334460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.334733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.335000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] PATH_INFO: `/v3/projects/b110753e43f8454597a752d36cf04107` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.336128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] RBAC: Authorizing `identity:get_project(project_id=b110753e43f8454597a752d36cf04107)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.337677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.339301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 227/453] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:07:34 2022] GET /identity/v3/projects/b110753e43f8454597a752d36cf04107 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:34.344904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:34.461241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6710e-1f37-4fa8-845d-fb04740aa16c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:34.468150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:34.497862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.498504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.498747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.499017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] PATH_INFO: `/v3/groups/e8745e0a9bc14975ac8366913dc06353` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.500174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] RBAC: Authorizing `identity:get_group(group_id=e8745e0a9bc14975ac8366913dc06353)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.501650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7154e-9b8f-40e6-9b0b-29bb7f14f5dc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.503211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 227/454] 10.222.0.61 () {56 vars in 1180 bytes} [Sat Aug 27 02:07:34 2022] GET /identity/v3/groups/e8745e0a9bc14975ac8366913dc06353 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:34.509421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:34.613177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4f908-054f-4965-93ee-7da402ba634d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:34.646281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:34.646869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:34.647146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:34.647416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:34.648142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] RBAC: Adding query filter params (group.id=e8745e0a9bc14975ac8366913dc06353, role.id=c388505e96244703b71034784851f8f0, scope.project.id=b110753e43f8454597a752d36cf04107) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:34.648449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:34.649998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f846c-cab2-4e00-b02b-70772471bda5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:34.655958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 228/455] 10.222.0.61 () {56 vars in 1376 bytes} [Sat Aug 27 02:07:34 2022] GET /identity/v3/role_assignments?group.id=e8745e0a9bc14975ac8366913dc06353&scope.project.id=b110753e43f8454597a752d36cf04107&role.id=c388505e96244703b71034784851f8f0 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:37.045487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850fd6b-8a65-48b7-9742-c1f3dc228857 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.046510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850fd6b-8a65-48b7-9742-c1f3dc228857 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.047049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850fd6b-8a65-48b7-9742-c1f3dc228857 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.048873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 228/456] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:37.053847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee475-04b6-41f9-b5bb-e4dbf764108f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.054696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee475-04b6-41f9-b5bb-e4dbf764108f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.055185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadee475-04b6-41f9-b5bb-e4dbf764108f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.082460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fadee475-04b6-41f9-b5bb-e4dbf764108f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:37.084022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fadee475-04b6-41f9-b5bb-e4dbf764108f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:37.123733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:37.179967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 229/457] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:37.551200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2ed0-9aa8-4121-a1cb-3641b4e6262e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.551485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2ed0-9aa8-4121-a1cb-3641b4e6262e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.552063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d2ed0-9aa8-4121-a1cb-3641b4e6262e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.553931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 229/458] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:37.558923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.559432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.559954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.571566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824936-1a82-4b02-a683-4b9dfeeef055 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.572183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824936-1a82-4b02-a683-4b9dfeeef055 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.572650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824936-1a82-4b02-a683-4b9dfeeef055 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.574470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 230/459] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:07:37.586515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457600f-1537-4745-bb6c-89f67aa611ec None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.586803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457600f-1537-4745-bb6c-89f67aa611ec None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.587281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457600f-1537-4745-bb6c-89f67aa611ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.589493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:37.590894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:37.614107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f457600f-1537-4745-bb6c-89f67aa611ec None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:37.615322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f457600f-1537-4745-bb6c-89f67aa611ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:37.663636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 230/460] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:37.664972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:37.689420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 231/461] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:37.779239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0777-2176-44e8-b8e9-c16c48d11c2b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.779626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0777-2176-44e8-b8e9-c16c48d11c2b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.779908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee0777-2176-44e8-b8e9-c16c48d11c2b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.781524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 232/462] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:07:37.786490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.786770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.787043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.805784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:37.807031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:37.816462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:37.828744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0c890-5cc6-40b8-b952-41696a8eb7b1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:37.895990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:37.896640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:37.896920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:37.897193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:37.916323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:37.917875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:37.934386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 233/463] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:37.947965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:37.948974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:37.950462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:37.950462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:37.950462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:37.950462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 231/464] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:37.954984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.000749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.002755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.080491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aca90b-1c4c-49f5-bf15-47ac24063585 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.105584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0b20-8aac-4e5e-aa3a-e073db928315 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.118758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.119522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.119949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.120390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.121337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:38.121572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.122838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.135799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 234/465] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:38.136797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.145660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.146627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.147105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.147571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.160314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.162101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:38.177654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:38.178599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:38.179476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:38.179476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.179476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:38.185617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.186536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 232/466] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:38.187480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.233383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.240955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43079966-2ffd-4a5d-8c18-bdf91cbcf2ad None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.279931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.280618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.280845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.281121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.292602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.294184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.296868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccefd4e-a054-4e8e-b6f8-7a9975a60924 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:38.310380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:38.311365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:38.313060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:38.313060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.313060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:38.313060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 235/467] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:38.313060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.347635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.348505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.348788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.349064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.349748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.351204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.381432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 233/468] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:38 2022] POST /identity/v3/users => generated 246 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:38.381432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.442608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241d007-19a2-4996-9680-37d1e7b74017 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.450595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.491070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.492143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.492599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.493036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.494059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:38.494628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.496474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.514028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c701a-ad5d-4b46-b56c-8035f32c5188 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.517707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 236/469] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:38.519652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.531284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.561003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.561674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.561953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.562225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.575824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.577283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:38.591846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:38.592791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:38.594091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:38.594091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:38.594091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:38.594091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 234/470] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:38.594091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.665051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a8866-0153-4f5e-9ed6-32cba79f59d1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.704214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.704830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.705097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.705369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.706297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:38.706599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.708445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.724926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 237/471] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:38.729829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.729949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302dde9-2723-472e-b64f-e69a590ab741 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.751820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.782963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.783585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.783891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.784140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.784909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.786632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.801632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:38.813543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 235/472] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:38 2022] POST /identity/v3/users => generated 248 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:38.814755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.847011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9b5ee-f3d0-4282-bd61-eee95b41632b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.885933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.887064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.887603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.888139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.889353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:38.889846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.891443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e8359-a0a5-4979-aefa-ced3edacf40d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:38.907888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 238/473] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:38.914245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbaf2-68d1-4d3b-b5af-6f9b6d62eb55 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.914579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbaf2-68d1-4d3b-b5af-6f9b6d62eb55 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.914927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbaf2-68d1-4d3b-b5af-6f9b6d62eb55 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.920948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 239/474] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:38.920948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cbaf2-68d1-4d3b-b5af-6f9b6d62eb55 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:38.944338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26e6c9-7d7c-4857-b83b-fda52768e1d5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:38.988801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:38.989584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:38.989961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:38.990332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:38.991090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:38.992697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ddcc3-10f1-4e83-9e4f-a82786eafb4d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:39.017790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 236/475] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:38 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:39.019898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:39.020194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:39.020470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:39.057964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:39.058956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:39.072860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cbaf2-68d1-4d3b-b5af-6f9b6d62eb55 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:39.084296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:39.122150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:39.142259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:39.142894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:39.143471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:39.143471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:39.144087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:39.149638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:39.179145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 240/476] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:38 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:39.210628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 237/477] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:39.491395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:39.616483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8ce62-601c-4258-9980-704aa89f8123 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:39.670799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:39.671453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:39.671758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:39.672025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:39.672705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:39.674093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:39.686752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.sql.core [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 02:07:39.686752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 02:07:39.686752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [parameters: {'id': 'b70fd14dad6643c6a45509752cf71406', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 02:07:39.686752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81748) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result.read() Aug 27 02:07:39.708784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return ref.to_dict() Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:07:39.709815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application yield resource Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise self.value Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application session.commit() Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 02:07:39.711384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.session.flush() Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application compat.raise_( Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:07:39.712249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:07:39.713165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result.read() Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:07:39.714021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [parameters: {'id': 'b70fd14dad6643c6a45509752cf71406', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:39.715876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 27 02:07:39.717951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:39.719924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 241/478] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Aug 27 02:07:39 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:39.720060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:39.843693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2f59d-cbc2-41c1-9392-3f6da88acf58 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:39.884809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:39.885479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:39.885761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:39.886029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:39.896639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-44460644-fcd8-4828-9edf-a4fe42bf90b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:39.901892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:39.902778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:39.904580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 238/479] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:07:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:39.908918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:39.988604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:40.068168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9816d0-9bc2-429f-a4b3-a9a8199c631b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:40.115210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:40.115795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:40.116119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:40.116395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:40.117059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:40.117358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:40.119190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad925c7-181d-4376-a025-038c236bfa9d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:40.129563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 242/480] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:40.700634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628dbf8-bf44-4fb6-945a-7fd4ea287bea None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:40.701564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628dbf8-bf44-4fb6-945a-7fd4ea287bea None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:40.702040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628dbf8-bf44-4fb6-945a-7fd4ea287bea None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:40.704000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 239/481] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:40.709343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4024e2-1922-4d55-a75d-f0bf009919b5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:40.709865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4024e2-1922-4d55-a75d-f0bf009919b5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:40.710330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4024e2-1922-4d55-a75d-f0bf009919b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:40.735476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-df4024e2-1922-4d55-a75d-f0bf009919b5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:40.736945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-df4024e2-1922-4d55-a75d-f0bf009919b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:40.806673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 243/482] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:41.245495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da027-ebaa-45e4-87b7-d15c5e6dffe2 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.245831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da027-ebaa-45e4-87b7-d15c5e6dffe2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.246108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430da027-ebaa-45e4-87b7-d15c5e6dffe2 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.248622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 240/483] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:41.254101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.254552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.254623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.278404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:41.279579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:41.279913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da027-ebaa-45e4-87b7-d15c5e6dffe2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:41.298103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:41.341413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:41.406385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 244/484] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:41.443063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430da027-ebaa-45e4-87b7-d15c5e6dffe2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:41.495235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:41.495923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.496146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.496413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.518342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0a1fab4d-2e80-4a7e-a9eb-febce9b7067a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:41.523165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:41.524054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:41.525665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 241/485] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:41.530840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:41.635433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d888c-c2d0-4c1f-8122-0348d7ffe5b5 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.635783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d888c-c2d0-4c1f-8122-0348d7ffe5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.635983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d888c-c2d0-4c1f-8122-0348d7ffe5b5 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.637457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 242/486] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:41.644356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.644846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.645560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.652983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572611c9-52e4-4f80-8e6b-cdccd14d3e14 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:41.675200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:41.676399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:41.708752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:41.709365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.709663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.709931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.710595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:41.710891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:41.712353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:41.721124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 245/487] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:41.721981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:41.759763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:41.766542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:41.773517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 243/488] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:07:41.778262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:41.851333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4943e-75ed-49bf-9717-94fe47117a7e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:41.895893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:41.896508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.896784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.897052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.901767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27375e8-80c7-40e4-8648-781636785e8c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:41.907979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-24d10489-06aa-4c8b-b46f-978edc2dec79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:41.913308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:41.914247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:41.915072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:41.919410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 246/489] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:41.920652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065d04-0a34-4a64-b39f-26501f1eb5c2 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.920931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065d04-0a34-4a64-b39f-26501f1eb5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.921201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42065d04-0a34-4a64-b39f-26501f1eb5c2 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.923005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 247/490] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:41.923625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065d04-0a34-4a64-b39f-26501f1eb5c2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:41.950649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:41.951933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.952823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.953654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:41.969475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:41.971005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-556f4e85-dee4-4c1d-9b78-b76556782cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:41.985780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:41.986698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:41.987541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:41.987541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:41.987541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:41.987541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 244/491] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:41.993062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:41.993607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:41.993991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.012980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:42.014250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:42.038559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.055406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42065d04-0a34-4a64-b39f-26501f1eb5c2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.066130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.089581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 245/492] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:42.089581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.094084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.094959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.095364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.095805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.096671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.097102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.098696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.112934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 248/493] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.114036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.198150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd08ac-6c27-4ec9-a3ce-26e56cae9c0f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.216172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa3528-4819-4f88-95a1-7fd3689c0031 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.233484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.234400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.234776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.235367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.235995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.236393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.237891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.253495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 246/494] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.254631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.257746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.258893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.259310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.259716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.271055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:42.276644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:42.277658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:42.278463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:42.281088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 249/495] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:42.282136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.298007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.306649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.371171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f33be-8218-4a73-a0cf-db5abbd7faa8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.392081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03cc2d-f8c6-47bd-88b4-37a30d292036 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.409634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.410277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.410641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.410847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.421582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.423121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.428736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.429371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.429670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.429946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.437110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:42.437328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:42.438226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:42.439049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:42.439049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:42.439049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:42.439049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 247/496] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:42.439678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.443175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:42.457151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:42.458155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 250/497] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:42.459025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.537301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.548371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.555053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d630-d897-4bc8-ab37-027fe14a5a4e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.568189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2c45-6309-43f7-84bf-d3669cbefc4c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.590920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.591516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.591796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.592062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.592725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.593129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.594699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.601293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.601952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.602228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.602497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.608029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 248/498] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.608029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.617347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:42.622671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:42.623583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:42.624403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 251/499] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:42.625844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.711056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6162615-5ba2-4783-93ed-c5d2445d5225 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.722078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5546d215-0781-45dd-960e-7699d5dea33d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.744128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.744733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.745016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.745289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.745970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.746275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.747654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.751140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.756262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.756860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.757133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.757418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.758151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.758452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.759394 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 249/500] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.759953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.760182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.779392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:42.796314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 252/501] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.797051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.861223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ce53-ad84-4372-8302-77bb1e059c16 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.895314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.895933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.896034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4568-b6ca-4041-8168-fc21bf46aec6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:42.896211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.896483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.907478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.908928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c6839d44-c773-44fd-b732-e437587adc64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:42.923947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:42.925100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:42.925973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:42.925973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:42.925973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:42.925973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 250/502] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:42.926189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32e5b-9367-49b0-a299-9bd4e35a5f16 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.926434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32e5b-9367-49b0-a299-9bd4e35a5f16 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.926735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b32e5b-9367-49b0-a299-9bd4e35a5f16 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.928421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 251/503] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:42.928731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b32e5b-9367-49b0-a299-9bd4e35a5f16 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.939733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:42.940332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:42.940608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:42.940872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:42.941589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:42.941890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:42.943293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:42.952360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 253/504] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:42.953108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:42.996118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.004078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.030426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b32e5b-9367-49b0-a299-9bd4e35a5f16 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.053388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3f1f4-1ee1-4241-b3ec-7c895d98afa0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.063613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.064227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.064513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.064786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.072140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.073608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:43.085696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:43.086728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:43.087927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:43.088436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.088521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 252/505] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:43.088521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.091779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.092079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.092355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.159788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.161253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.184965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29f7b-5201-4a64-a342-bdba25d0cc81 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.210080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.211638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.220104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.220710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.221036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.221311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.221982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:43.222283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.223689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a65178-9730-465c-9251-b4e8858d96fa None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.235509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 253/506] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:43.236857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.237143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.237430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.254321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:43.255506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:43.257276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 254/507] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:43.258000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.329547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 254/508] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:43.330396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.367068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227526d2-6aba-4c7c-8ace-31bb8ac59f29 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.403963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.404581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.404854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.405118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.415859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.417316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:43.431646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:43.432576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:43.433465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:43.433465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.433465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:43.433465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 255/509] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:43.433465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.439374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.450945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb411fe-098e-46b1-afa2-e031b19ff954 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.472905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.490347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.490950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.491222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.491492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.492213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:43.492521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.494012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.534348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 255/510] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:43.535183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.553562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c14b89-dd82-45de-8040-ac26f620f9e3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.590393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.591075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.591280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.591543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.599379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.600908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:43.611932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:43.613011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:43.613962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:43.617571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 256/511] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:43.618337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.641275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbee33-84ea-4d98-a4f8-d4495deb5997 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.676489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.677113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.677386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.677682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.680405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.688410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.689933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:43.704627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:43.705758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:43.706800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:43.706800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.706800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:43.706800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 256/512] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:43.706800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.720905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6c68d-45a4-4bfa-9fd5-adc849f84a8c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.734974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.756143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.756749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.757018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.757279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.757940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:43.758238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.759635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.771526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 257/513] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:43.772302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:43.806124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877fed0-16f3-48aa-9335-185bfb8eca4e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.838479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.839101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.839366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.839636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.871297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1233bc-c3bf-411e-b531-fd90de7e8795 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:43.895367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.904973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.906482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.907166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:43.907789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:43.908063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:43.908444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:43.918497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:43.919945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:43.932753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:43.935071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:43.935965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:43.936791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:43.936791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:43.936791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:43.936791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 258/514] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:43.937324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.005710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 257/515] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:44.006557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.040577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a062ebbd-7821-4545-b2c7-8bc002a32cda None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.075513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.076111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.076386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.076679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.077440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.077738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.079172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.095931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 259/516] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.096554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.108042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d837a6f-e75d-4986-bd8b-3ba5ffea95d5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.128789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.136105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.144504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.145113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.145419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.145690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.146335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.146631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.148023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.159274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 258/517] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.160045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.198303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21535cb5-8e32-404a-a93f-7d4d634e3351 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.230778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.231402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.231680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.231951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.238961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.240408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:44.251806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:44.252681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 260/518] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:44.254116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.262478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911de38a-9782-4c57-b224-84d7d0610fca None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.296456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.297058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.297336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.297644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.298282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.298593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.299942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.314535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 259/519] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.315588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.350709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.359045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a9394d-532f-4d1d-8e2e-8b37612fdd2e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.368771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.394176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.394735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.395045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.395278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.407933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.409638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.420428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376937b2-2f52-44c8-8215-445a67db965c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:44.425214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:44.426186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:44.427022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:44.427022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:44.427022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:44.427022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 261/520] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:44.427247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.456954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.457680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.457960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.458240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.524314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.526152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.526260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76517cd7-e33d-4230-babb-22e3b63568ab None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.559579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.560205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.560476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.560745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.567231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.568682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.571090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:44.580475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:44.581611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 262/521] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:44.582459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.592742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.625749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 260/522] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:44.626565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.687142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb61f21b-bb66-47c6-ac35-df6ef2188eb4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.720689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.721323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.721647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.721917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.722648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.722948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.724393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.731251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea1ac-b21e-477c-97b5-8131eaafbaf1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.743273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 263/523] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.743273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.773824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.774432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.774746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.775014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.775966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.777488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.799081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 261/524] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:07:44 2022] POST /identity/v3/users => generated 247 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:07:44.799723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.811288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.815039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:44.853188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b764eb-707e-4a34-87f1-b1686a554d32 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.893619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.894235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.894565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.894827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.895481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.895785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.897197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.914879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 264/525] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.915931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:44.924312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7204b-faee-4a97-bb2c-4e1e57c15f60 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:44.963542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:44.964068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:44.964348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:44.964649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:44.965373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:44.965707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:44.967143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:44.986967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 262/526] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:44.987818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.023666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b092-a2ed-4ddb-9284-d33ab27d9f4b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.046867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.054848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.062081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.062731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.063003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.063243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.074428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.075942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:45.093088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:45.094226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:45.095338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:45.095338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:45.095338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:45.096746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 265/527] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:45.096999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c359500-16ae-4af4-bab4-dbcf2510ad40 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.097827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.134722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.135329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.135606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.135871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.204422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f1ce-9a69-446a-977f-5406453cbcb5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.208318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.209826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.242531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.243103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.243440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.243713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.250708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.252150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:45.263539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:45.264429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:45.265280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 266/528] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:45.265774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.281048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.305306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.330472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 263/529] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:45.331312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.383083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80db1-6f91-468b-976a-0b93b026d60c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.416457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.417048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.417320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.417613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.418334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:45.418639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.420058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.425804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 267/530] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:45.426824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.446913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4950b6-0b5c-46d1-a1ea-20894b7d2803 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.500043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.501306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.501832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.502304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.503244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:45.504091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.506793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.527294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 264/531] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:45.528547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.549291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.554536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffece69f-2f83-4c35-b4e7-84290a2765d0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.563134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.595701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.596600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.597012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.597571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.598506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:45.598954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.600502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.622725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 268/532] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:45.623841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.652612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58c839-ce9a-4bc3-84df-745e7346a2da None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.689860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.690496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.690773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.691060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.703476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.705235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:45.721806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:45.722928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:45.723934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:45.723934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:45.723934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:45.725882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 265/533] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:45.726812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.737724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174c592-996e-4389-afee-cbdca1f7e962 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.783557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.784308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.784746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.785355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.801460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.801460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.813076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:45.818609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:45.819467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:45.820310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:45.824996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 269/534] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:45.826383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.846749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a801ce-c0b4-447a-b06f-09da2b0afdd2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:45.854036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:45.890027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:45.891390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:45.891880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:45.892339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:45.893266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=e5b1a97a2fad45899863619a3953e0c2) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:45.894332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:45.896255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:45.905599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 266/535] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/role_assignments?user.id=e5b1a97a2fad45899863619a3953e0c2&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:45.906837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:45.963974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f7899-45a0-48b1-a2a4-09bf069b75d1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.031414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.032382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.032824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.033267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.034181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:46.036809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.038532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.059217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 270/536] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:46.065225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:46.120962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f934008-3890-45a5-9805-31e6f8b83d04 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.163212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:46.185223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3dd866-620b-41ff-868f-b556091a0afb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.195024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.195657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.196112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.196215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.196943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:46.197256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.198735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.223317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:46.228115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.230159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 267/537] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:46.230957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.231389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.231839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.236302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:46.249469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.251161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:46.271031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:46.272080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:46.273080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:46.275017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 271/538] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:46.280860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:46.362879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff38dd1-a814-4621-985c-2e15047a6ac5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.397517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df0656-7761-4d78-bc06-117598669268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.398250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0656-7761-4d78-bc06-117598669268 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.398527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0656-7761-4d78-bc06-117598669268 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.398868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df0656-7761-4d78-bc06-117598669268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.399619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df0656-7761-4d78-bc06-117598669268 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=24b6f745fb3e4451b182536941eb21d7) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:46.399924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df0656-7761-4d78-bc06-117598669268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.401839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df0656-7761-4d78-bc06-117598669268 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.410239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 268/539] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:46 2022] GET /identity/v3/role_assignments?user.id=24b6f745fb3e4451b182536941eb21d7&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:46.450900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40679e5-a461-4a5a-8620-477e06a7c803 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.496935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.497605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.497895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.498162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.498882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:46.499187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.500671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd32637-233d-4a0b-8778-0f3e96d866eb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.520878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 272/540] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:46.521796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:46.527503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df0656-7761-4d78-bc06-117598669268 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:46.609780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:46.654478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df0656-7761-4d78-bc06-117598669268 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:46.691804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:46.692760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.693291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.693825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.694762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=5340cd7471884cc2b5a584d7e435d447) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:46.695265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:46.696990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a3eff-f959-4a1f-86c2-f8d4abaed122 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:46.703470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 269/541] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:46 2022] GET /identity/v3/role_assignments?user.id=5340cd7471884cc2b5a584d7e435d447&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:46.929330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc3cc-b805-4f5f-9f0b-a5058e1e0a7c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.929739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc3cc-b805-4f5f-9f0b-a5058e1e0a7c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.929917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fc3cc-b805-4f5f-9f0b-a5058e1e0a7c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.931547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 273/542] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:46.937011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:46.937456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:46.937659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:46.960185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:46.961382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:47.056126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 270/543] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:47.523212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc3cc-b805-4f5f-9f0b-a5058e1e0a7c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:47.651393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fc3cc-b805-4f5f-9f0b-a5058e1e0a7c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:47.695069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:47.695711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:47.695984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:47.696251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:47.713540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8cdc2ee0-ac42-49f8-9950-6c3aa48b4934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:47.718390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:47.719259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:47.720046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 274/544] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:47.725378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:47.742869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c90-b988-4716-8b6f-ec8ed5e2e22d None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:47.743201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c90-b988-4716-8b6f-ec8ed5e2e22d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:47.743443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4139c90-b988-4716-8b6f-ec8ed5e2e22d None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:47.746249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 275/545] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:47.750970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:47.751246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:47.751515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:47.780951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:47.782183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:47.832340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:47.877873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788a89a-7a69-42f2-8275-397a32080aeb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:47.905795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:47.929243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 276/546] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:47.943499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:47.944382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:47.944662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:47.944979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:47.945782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:47.946081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:47.947535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a788c4a-3fb7-42c5-a382-8df6aadf9905 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:47.960760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 271/547] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:47.966387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.097344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc61e66-4f9a-46e3-8ade-9da452109e2a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.106460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526cbc-6efe-422d-bb0c-645471c5c730 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.106831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526cbc-6efe-422d-bb0c-645471c5c730 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.107198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d526cbc-6efe-422d-bb0c-645471c5c730 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.109166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 272/548] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:48.114571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.114864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.115122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.136350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.136988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.137262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.137560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.147646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.150065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.154384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:48.155568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:48.180953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:48.181934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:48.182884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:48.182884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:48.182884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:48.189574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 277/549] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:48.191712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.251005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.254914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 273/550] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:48.255786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.311291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.365276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed73879-a7a0-40d3-80d9-ae027e34ea1f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.400933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e4383-388e-4653-855b-dd19b7fd3001 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.401892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.402670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.402966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.403235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.427508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:48.432404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:48.433893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:48.434790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:48.446037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 274/551] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:48.447165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.502114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.502841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.503119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.503387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.504029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:48.504324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.505736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.539847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 278/552] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:07:48.543505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.553223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecc416-8208-4fea-aaf6-f587a68a49e6 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.585771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.599163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.600293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.600649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.600991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.601960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:48.602265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.604450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.614770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 275/553] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:48.617258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.657534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47bba-d031-4f61-9700-e0950a105dee None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.661876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.707497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.708052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.708312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.708582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.721363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:48.727910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:48.729131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:48.730049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 279/554] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:48.731067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.757207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961121c-a667-4898-a20a-f6f253eb3ffc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.801414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.802345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.802989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.803422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.814136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.816886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:48.831620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:48.832752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:07:48.834185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:48.835540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 276/555] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:48.840314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.863282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62237e49-cd39-4482-8b00-af65cda641cb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.876864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.899610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.901074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.901588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.902071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.913041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.914852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:48.930960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:48.931925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:48.933287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:48.933287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:48.933287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:48.935284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 280/556] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:48.936274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:48.950601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f6f47-2375-40d5-b619-cbe67aa4984e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:48.953832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:48.986797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:48.987318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.987596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:48.987866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:48.988533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:48.988831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:48.990231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b96ab-9e23-4144-89d7-682dc0c8d728 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:48.998348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 277/557] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:48.999598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136b86-ac70-4f81-be27-d5d386101d58 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:48.999797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136b86-ac70-4f81-be27-d5d386101d58 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.000091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa136b86-ac70-4f81-be27-d5d386101d58 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.001221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 278/558] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:49.001926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136b86-ac70-4f81-be27-d5d386101d58 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.047419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dfb14-d9a4-4c66-aa5c-55d86be30d37 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.081299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.081966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.082240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.082508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.083230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:49.083516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.084958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389a598-cc86-43a4-aee5-f2b8d44a4021 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.096368 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.102011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 281/559] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:07:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:49.103339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3dfc-c41e-4969-a2f8-fba2a1aee61c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.103618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3dfc-c41e-4969-a2f8-fba2a1aee61c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.103889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a3dfc-c41e-4969-a2f8-fba2a1aee61c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.104709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa136b86-ac70-4f81-be27-d5d386101d58 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.109174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 282/560] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:49.109174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3dfc-c41e-4969-a2f8-fba2a1aee61c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.142376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.142975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.143248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.143514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.144146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:49.144444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.145838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3724fb7-c030-4ea4-aeef-99e1b40cef30 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.157715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 279/561] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:49.158832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.159115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.159391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.176030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:49.176203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.177263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:49.207760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a3dfc-c41e-4969-a2f8-fba2a1aee61c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.240755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.241193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 280/562] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:49.241337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.241591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.241856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.242030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.257596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.259120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-6c1b7961-589c-488a-810e-b96631288e42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:49.273582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:49.274716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:49.276123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:49.276123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:49.276123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:49.276123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 283/563] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:49.276123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.276449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.276782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.295142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:49.296340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:49.340777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.359609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d34d8-3b7a-4ca1-8f77-afb60f001f99 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.367266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 284/564] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:49.368335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.405684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.407268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.407620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.407964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.429307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.478400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626b09-cc7c-416f-a82d-4198ec35bc70 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.498860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.500933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.516171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.516903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.517179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.517470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.524734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.526507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:49.538734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:49.539697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:49.541092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:49.542898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 285/565] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:49.544180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.591874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.609083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 281/566] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:49.609940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.661511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452034b-ee5c-45fa-977e-25a8e5b2b511 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.674610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.695342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.695999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.696331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.696605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.697266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:49.697582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.698948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.712486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404b8e-b3b0-48fd-ba19-df4a548091d8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.712683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 286/567] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:49.713506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.747305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.747933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.748212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.748483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.758732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:49.763505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:49.764587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:49.765656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 282/568] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:49.766367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.817268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.818802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bcd69-596b-41ff-9e3c-b3729212f75f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.852862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.853489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.853764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.854041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.854734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:49.855052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.856489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.873695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 287/569] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:49.873899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a489-9f1d-498b-9249-bde583a3f0bc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:49.874494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.906177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:49.912546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:49.913178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:49.913494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:49.913788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:49.924319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:49.925832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:49.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:49.941978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:49.942913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:49.942913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:49.942913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:49.942913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 283/570] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:49.942913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:49.976848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50782ebb-d082-4c2c-bed7-923cae03b27c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.010689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.011241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.011522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.011791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.021854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:50.026929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.027869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:50.028720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 288/571] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.029514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.039576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.046201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87ac1a-ceba-4ac6-98f5-392981f9b011 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.079425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.080048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.080365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.080696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.088123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.089603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:50.101205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.102260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 284/572] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.103417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.122373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.132554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfba769-cd01-450f-822e-4e0f793972b7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.168827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.169455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.169737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.170005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.170662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.170962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.172325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.180105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 289/573] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.180875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.211187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b853872-3e54-4b1d-b554-f5405e092099 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.243838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.244462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.244747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.245017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.255392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.256831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:50.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.271632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:50.272507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:50.272507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.272507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:50.272507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 285/574] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.272507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.283170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.283315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48d3e3-4f0d-4e94-9dc8-9deb266f1891 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.323297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.323913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.324192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.324458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.325096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.325426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.326800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.338612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 290/575] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.339307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.355435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.380058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af254d-9a40-4999-8bc0-66a62ef3ac78 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.413216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.413845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.414126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.414405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.415095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.415399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.416789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.425233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 286/576] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.426064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.441262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422bc65-0ec4-4f1d-b15a-09e86b181fac None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.474178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.474749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.475050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.475316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.476032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.476317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.477793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.494805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 291/577] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.495500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.502456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.536371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f332733-ea28-4523-9f5d-705107e5b769 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.565562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.570057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.570691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.570963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.571252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.581826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.583293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.595099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f78c84-0478-43b4-aaa1-40172d1131fd None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:50.598004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.599067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:50.600273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:50.600273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.600273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:50.600273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 287/578] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.600273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.631391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.631991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.632255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.632543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.633152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.633470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.634897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.646622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 292/579] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.647399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.702286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255799e-ad00-4bfd-8eec-ba5bd0863aae None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.723940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.736531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.737162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.737461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.737730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.744754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.746222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.746938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7654c60-14c1-4f20-916b-11cae4e33149 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:50.757960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.758966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 288/580] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.764775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.783047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.788594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.789195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.789493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.789762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.800205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.801677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:50.815747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.816864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:50.818061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:50.818061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.818061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:50.818061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 293/581] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.818061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.864106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a1537-e2e8-411a-bf31-d506d2a1199f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.897008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.897647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.897928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.898195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.909535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.910963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.918186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681b3ac-d9ca-4540-a37a-3ff3654b1ca7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:50.926279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:50.927395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:50.928502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:50.928502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:50.928502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:50.928502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 289/582] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:50.928502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:50.954982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:50.955597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:50.955883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:50.956150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:50.956787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:50.957086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:50.958743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:50.962428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:50.973978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 294/583] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:50.979389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.029894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.036282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe0c8-6392-452c-8297-1e45e1295337 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.070075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.070701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.070967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.071265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.082374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.084263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.090849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33578d65-2a50-4183-8b67-30b50686a7eb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:51.095748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:51.096674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 290/584] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:51.097607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.137422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.137422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.137422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.137422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.137813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.137813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.138538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.150718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 295/585] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.151837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.204566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.212922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053213c2-0d49-428b-9c40-e3a85a301ad3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.253742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.254354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.254916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.255199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.255903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.256141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.257838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.262141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e3d42-2845-40ea-917a-9622b1d725be None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.264440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.270654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 291/586] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.271495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.299852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.300465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.300744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.301021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.301695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.301998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.303368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.315573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 296/587] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.316432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.368430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b551be0-80b1-45e2-9262-c47a319ca2df None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.403005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.403625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.403902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.404188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.411123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.412553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.414097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379740b-aa27-420e-b111-7c75d9721cb6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:51.424143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:51.425129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:51.426464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 292/588] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:51.428029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.443285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.448571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.449170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.449473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.449740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.450423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.450720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.452167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.463258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 297/589] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.464022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.488083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.532663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd206ee9-122d-4f1f-bbfb-0fd3dd32f45c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.563504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f910df-17a7-49e3-bd8d-8f48a8c68b96 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.565989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.566620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.566892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.567161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.567883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=6e7b457718554fac8c6e8fefea700674) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.568186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.569630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.575101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 293/590] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/role_assignments?user.id=6e7b457718554fac8c6e8fefea700674&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.575880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.600377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.601034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.601313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.601628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.610174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.611643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:51.626263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:51.627261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:51.628195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 298/591] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:51.628789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.686015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.713751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95d561-b7aa-424e-a95b-deb5655a6b93 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.731897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.758925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5c0-d318-4389-b601-b325f2886974 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.760657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.761754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.762315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.762723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.773091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.776024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:51.794301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:51.796179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 294/592] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:51.798097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.814436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.815156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.815430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.815697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.816424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.816729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.818183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.836289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 299/593] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:51.837217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:51.915110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a2c8-9634-48a1-b724-1434eebd536a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.937256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3175e-f08e-466f-b635-e06849564e60 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:51.950214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.951159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.951619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.952086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.962419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:51.970375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=9ddf36f45acc45fe99073dec8c3ee497, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.972088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.973893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:51.974927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:51.975253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:51.975494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:51.976227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:51.976682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:51.978332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:51.986991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 295/594] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:51 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:51.988345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.005437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.014748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 300/595] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:52.015824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.118583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5be19-0dd3-4119-9e0a-54049fc4cf27 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.147153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e08a3f-fdad-45e4-808f-1c01b418cf81 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.167989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.168567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.169221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.169221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.169906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:52.170211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.171663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.185201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 296/596] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:52.186172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.194487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.195435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.195913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.196433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.207986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.209814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:52.226078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:52.227053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:52.228137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:52.228137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:52.228137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:52.230124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 301/597] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:52.231016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.248187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.301979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.309880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cae5a0-24e3-4d31-ae51-3d55ffc31fa1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.358409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.359303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.359588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.359864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.361367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e691d7-15dc-4bb1-9d4e-e27ed6f47aaa None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.373370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.375099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:52.395301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:52.396302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:52.397622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:52.397622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:52.397622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:52.397622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 297/598] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:52.397622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.401836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.402704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.403202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.403617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/e5b1a97a2fad45899863619a3953e0c2/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.420048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=e5b1a97a2fad45899863619a3953e0c2, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.421852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.439442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 302/599] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:52 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/e5b1a97a2fad45899863619a3953e0c2/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:52.440603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.568477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c35e6-54ff-4e9b-87b1-ba4cc6f692cb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.570476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.578226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.581809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d9e91-b99e-48d8-82b6-5dc507d7e604 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.617705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.619538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.619962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.620371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.621158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:52.621619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.623815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.638619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 303/600] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:52.647240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.665881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.666507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.666784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.667054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.667715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:52.668016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.669431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.696519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 298/601] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:52.702736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.806463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca1078-5ccd-4e3b-811d-684c6fddc3a3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.819402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a4e1-be3d-4b3f-884d-867df5939490 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:52.842449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.843582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.844204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.844566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.853095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.855196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:52.868326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:52.869369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:52.870440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:52.872731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 304/602] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:52.878032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.886636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553e731-4709-4727-8141-60c02329f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:52.887493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553e731-4709-4727-8141-60c02329f254 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:52.887913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553e731-4709-4727-8141-60c02329f254 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:52.888784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553e731-4709-4727-8141-60c02329f254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:52.906085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553e731-4709-4727-8141-60c02329f254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:52.908548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553e731-4709-4727-8141-60c02329f254 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:52.917811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-a553e731-4709-4727-8141-60c02329f254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:52.935669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:52.936808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:52.937959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:52.941261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 299/603] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:52.949977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553e731-4709-4727-8141-60c02329f254 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:52.993353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:53.052535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c167c7-5e8c-4fd2-b6c1-736bbc7ec7fc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:53.081069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553e731-4709-4727-8141-60c02329f254 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:53.115948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:53.116939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.117387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:53.117684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.118066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.118405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.118519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.118711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.119452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:53.119759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:53.120411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:53.120919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:53.121189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:53.122757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:53.144102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 300/604] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:53.145115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:53.155998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 305/605] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:53.161847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:53.301840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:53.316448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:53.334452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215619b6-37f7-4dab-a398-149fe4ac0e13 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:53.354256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217501b4-ff92-4e5d-921a-7b9d6cb035ff None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:53.402920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:53.403590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.403866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.404137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/5340cd7471884cc2b5a584d7e435d447/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.419567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:53.420231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.420502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.420768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/24b6f745fb3e4451b182536941eb21d7/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.437473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=5340cd7471884cc2b5a584d7e435d447, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:53.438935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87de55f-9409-4cc2-bd0b-4bd173ed5069 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:53.448385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=24b6f745fb3e4451b182536941eb21d7, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:53.451306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0175e-d814-4896-827e-215c783f11ef None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:53.464366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 306/606] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:53 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/5340cd7471884cc2b5a584d7e435d447/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:07:53.474770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 301/607] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:53 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/24b6f745fb3e4451b182536941eb21d7/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:53.758986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f3ee-c26d-4982-8e6c-e5cc318fd231 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.759520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f3ee-c26d-4982-8e6c-e5cc318fd231 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.759791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f3ee-c26d-4982-8e6c-e5cc318fd231 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.761511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 307/608] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:53.766631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e065-4791-4368-a2d1-41ed82733b7e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:53.766991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e065-4791-4368-a2d1-41ed82733b7e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:53.767328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877e065-4791-4368-a2d1-41ed82733b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:53.785869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3877e065-4791-4368-a2d1-41ed82733b7e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:53.787059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3877e065-4791-4368-a2d1-41ed82733b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:53.856661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 302/609] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:54.089416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233c39-6875-4b39-9f66-fd2b930bcc94 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.089956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233c39-6875-4b39-9f66-fd2b930bcc94 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.090335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233c39-6875-4b39-9f66-fd2b930bcc94 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.092017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 308/610] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:54.097343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.097775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.098140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.116509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:54.117714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:54.175438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:54.192624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 303/611] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:54.274675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233c39-6875-4b39-9f66-fd2b930bcc94 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:54.422084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233c39-6875-4b39-9f66-fd2b930bcc94 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:54.457891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:54.463756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:54.464392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.469751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.470030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.485077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:54.490177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:54.491156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:54.492647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 309/612] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:54.497280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:54.503903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:54.612640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07634d31-27c8-4037-a2b1-106558f42863 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:54.668103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:54.668738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.669008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.669274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.702809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:54.709879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:54.710828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:54.711709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:54.714336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3e82-3c06-4b3b-8e7b-0f1f06ef8ba0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:54.717842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 310/613] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:07:54.733556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:54.759057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:54.759671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.759948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.760217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.760885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:54.761184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:54.762736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:54.772096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 304/614] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:54.778454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:54.847098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:54.853483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:54.902660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb6226-18ef-4967-909d-3d6e57054422 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:54.937656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:54.938285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.938560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.938878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.956543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:54.958012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-30e37e66-0ad8-45d7-9224-9a0fa5b19701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:54.973131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:54.974204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:54.975884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:54.975884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:54.975884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:54.975884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 305/615] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:54.976152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c56d-a9bb-42e9-8af2-591b97761ab1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:54.980560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046a85-a795-4033-9e18-c8ffb856e5e6 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:54.980901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046a85-a795-4033-9e18-c8ffb856e5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:54.981250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24046a85-a795-4033-9e18-c8ffb856e5e6 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:54.982804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 306/616] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:54.983540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046a85-a795-4033-9e18-c8ffb856e5e6 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.010791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.011774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.012180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.012547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.013308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:55.013693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.015163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0c653-bbb6-4941-b424-f503b1cfa4b1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.024623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 311/617] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:55.026640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.026924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.027194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.047882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:55.049094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:55.103721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24046a85-a795-4033-9e18-c8ffb856e5e6 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.107278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.143923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.144527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.144800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.145064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.145747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:55.146037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.147399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.151787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 312/618] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:55.152992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.159878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 307/619] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:55.165374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.215525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.308367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d4ad18-07e9-42ed-a2b5-aeceac7be711 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.325432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b6075-57b9-482c-98c5-a74a232fd5a7 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.370255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.370887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.371165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.371434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.374448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.375073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.375345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.375613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.387018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.388552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:55.401827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:55.402865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:55.403976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 308/620] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:55.410115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.410377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.411705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:55.427143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:55.429156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:55.431096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:55.431096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:55.431096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:55.431096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 313/621] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:55.434548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.467829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.561898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece63d-8806-4568-9c6b-5623e92d2d0d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.568603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b4333-2dbd-4b69-8c94-5eb336add124 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.581794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.596827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.597665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.597956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.598226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.599110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:55.599411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.600839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.613929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.614553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.614829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.615099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.615748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:55.616051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.617479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.624865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 309/622] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:55.625834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.632091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 314/623] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:55.632954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.715820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.740418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8d5a-3586-47f8-be75-726216e32de3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.745046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbe112-09f7-4900-89d9-d530e504c5bb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.778201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.778843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.779123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.779396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.781410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.782417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.782694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.782962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.790530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:55.794775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:55.795366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:55.796257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:55.797095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:55.798393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.801332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 310/624] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:55.802182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-83705047-eb4b-434a-b27f-7b45e8cdc6ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:55.813122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:55.814123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:55.814994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:55.814994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:55.814994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:55.814994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 315/625] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:55.815975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73243-9f49-403f-b44c-d01c159f1d3e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.815975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73243-9f49-403f-b44c-d01c159f1d3e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.815975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa73243-9f49-403f-b44c-d01c159f1d3e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.817295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 316/626] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:55.817871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa73243-9f49-403f-b44c-d01c159f1d3e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.832102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.910636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a46e7-59dd-4a1c-bcb1-121f89e3852b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.929347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa73243-9f49-403f-b44c-d01c159f1d3e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:55.943244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.943876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.944173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.944435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.951391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.952891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.961729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:55.962325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.962599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.962866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.963520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:55.963818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:55.964214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:55.965149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:07:55.966196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:55.966726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3be44d-e74a-4f8f-b282-93a2bfcd1f35 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:55.966796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 311/627] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:55.966796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:55.968546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:55.978189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 317/628] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:55.979393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea649ea-ed74-40b9-b4dd-0425c403089f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:55.979671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea649ea-ed74-40b9-b4dd-0425c403089f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:55.979938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea649ea-ed74-40b9-b4dd-0425c403089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:55.998229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9ea649ea-ed74-40b9-b4dd-0425c403089f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:55.999327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9ea649ea-ed74-40b9-b4dd-0425c403089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:56.059692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.064507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 318/629] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:56.065884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe820b-5827-4773-8a9f-c9eb8a6b1f40 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.066172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe820b-5827-4773-8a9f-c9eb8a6b1f40 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.066444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe820b-5827-4773-8a9f-c9eb8a6b1f40 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.067538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62ea2a-6229-4d79-9b96-b7924b1d2c5f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.069651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 319/630] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:56.069651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe820b-5827-4773-8a9f-c9eb8a6b1f40 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.103104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.103781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.104073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.104338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.104994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:56.105294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.106695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.118879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 312/631] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:56.119682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.184885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.189230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe820b-5827-4773-8a9f-c9eb8a6b1f40 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.226430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4fd86-3311-4b77-95a4-9b83c7183c88 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.226895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.227571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.227884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.228159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.228885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:56.229365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.231614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce83c72-c0e6-41bf-a7db-99c19dbcf614 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.249881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 320/632] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:56.251004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.251265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.251560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.270375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:56.271290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.271419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:56.272469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.273031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.273669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.286668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.288156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:56.303686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:56.304715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:56.306108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:56.306108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:56.306108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:56.306108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 313/633] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:56.311078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.339131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.354507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 321/634] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:56.355315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.417089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749e677-d352-4c41-b4e4-4fdbf941b154 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.430718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.451333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.451955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.452232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.452504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.459135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.460583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.463646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ed1e-afe3-48e9-b34b-ea7836ded7ee None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:56.472208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:56.473137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 314/635] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:56.474296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.503692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.504582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.505054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.505537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.566233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.581891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.583377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.592920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91030a1-3dc0-4406-8682-7198fb03b286 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.628848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.629487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.629762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.630030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.630667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:56.630966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.632328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.644038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 315/636] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:56.644925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.679886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.684053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 322/637] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:56.684910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.748356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964557d6-41c5-441a-b006-4de3c4b5d1c5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.779949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.783339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.783918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.784193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.784467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.792719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e79ca1-ca37-433b-b8ed-26b23d9970b6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.794656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:56.799418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:56.800664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 316/638] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:56.802028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.833719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.834327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.834605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.834875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.835564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:56.835867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.837366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:56.849118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 323/639] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:56.849771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.899596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:56.907526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b677cd-32b5-4f97-b88f-a8afe9c49f5c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.942522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.943144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.943423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.943721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.953317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee95516-c052-4165-b7f9-e659614c58ce None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:56.953815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:07:56.958374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:56.959309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:56.960157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 317/640] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:56.961296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:56.988562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:56.989182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:56.989493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:56.989769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:56.997667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:56.999112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:57.010260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:57.011276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 324/641] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:57.012242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.027289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.061132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ac738-89d4-4d76-87eb-35f2d10bf8ea None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.094185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.094816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.095094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.095391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.105308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.106817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:57.121764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:57.122729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:57.123764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:57.123764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.123764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:57.123764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 318/642] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:57.123764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.131214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9386f9-6462-4334-8b19-2bd46671e792 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.132662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.165107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.165759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.166036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.166339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.166982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:57.167279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.168641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.176264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 325/643] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:57.177032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.232061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462ee51-c7ec-46db-bc8d-4b7f0d334de0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.245120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.269679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.270337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.270618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.270897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/6e7b457718554fac8c6e8fefea700674/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.280760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567010f-a158-4590-94a6-c17d95cb24f1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.285858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=6e7b457718554fac8c6e8fefea700674, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.287288 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.301423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 319/644] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:07:57 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/6e7b457718554fac8c6e8fefea700674/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:07:57.302174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.320995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.321662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.321964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.322236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.322917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:57.323220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.324680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.334221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 326/645] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:57.334881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.381780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.438322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4c1e-578e-4771-8606-747aab649536 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.442594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd683b0-ce60-428a-b702-9aa201c5bc5d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.475533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.482561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.483191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.483461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.483734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.484315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.484460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:57.484663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.485336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.485840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.486073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.486406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.487266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:57.487966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.490074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.501438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 327/646] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:57.501438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.510210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 320/647] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:57.511286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.609770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca1cda-7955-4121-9aab-42d947bdecbb None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.612765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6a623-1ff6-44cd-8f79-5e29013ff1a1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.624463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.648027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.648656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.648932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.649222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.657299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.658466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.658786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.659385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.659805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.661263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.671624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.673042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:57.679097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:57.680096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:57.681007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:57.681007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.681007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:57.681604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 321/648] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:57.682397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:57.693662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:57.694715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:57.695594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:57.695594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:57.695594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:57.696310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 328/649] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:57.697264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.750382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.797411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf6979-3fb9-4728-8d8e-5de50e980138 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.815777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107d0b3-1ea9-4fec-b1e0-ceeb37996040 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.838247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.839265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.839265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.839516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.847005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.848456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.854205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:57.854911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:57.854911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:57.855124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:57.860908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:57.862011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 322/650] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:57.868007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:57.897910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:57.932869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:57.934382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:57.976029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b635b1-ff3b-4f12-8fc1-54123f97c115 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:57.980713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.012795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.013346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.013698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.013972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.014648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.014958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.016407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.029600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 323/651] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.030498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.045474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 329/652] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:58.046561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.124606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.140366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065874b6-93a0-44e2-9513-2183b445d0d6 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.160135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4249f-3fbb-4737-828a-c6da4907bf63 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.178698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.179528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.179803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.180070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.180733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.181029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.182420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.197991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 324/653] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.197991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.201763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.203254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.203531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.203807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.204499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.204826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.206393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.222281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 330/654] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.226283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.232237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.313763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c5c0-aa71-4c1d-9810-19a61823b3ba None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.350324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5db056-b8d4-49d6-9dff-3d0b9222d0b3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.350932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.351662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.351948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.352287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.360669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.362076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:58.375940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:58.377074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 325/655] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:58.378142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.389554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.401421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.402069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.402764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.403044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.417424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.419141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:58.435452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:58.436541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:58.437641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:58.437641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:58.437641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:58.437641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 331/656] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:58.437641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.498834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.500961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bad9f5-3164-4036-8681-eb5e0e0e054a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.535754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.536517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.536897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.537279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.544869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.546149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbe703-5c84-49e3-80f7-c0b7f4a593f2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.546538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:07:58.559078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:58.560228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:07:58.561379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:58.563200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 326/657] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:58.564082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.588791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.589571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.589964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.590338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.591254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.591744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.593256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.605888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 332/658] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.608043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.639449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.682494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277d678-1cb4-405d-a28d-a3961b714450 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.727865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.729303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.730033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.730465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.731375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.732188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.734518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.757177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec74cec-8411-4f7d-a561-034e510eeeb2 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.758176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 327/659] 10.222.0.61 () {56 vars in 1139 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.760510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.783091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.799833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.800456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.800823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.801084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.801838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.802202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.804075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.819159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 333/660] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.820217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.890441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29243549-20e9-4db4-a95a-19568b835d94 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.921012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:58.933727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.934671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.935193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.935694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:58.936634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:58.937143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:58.939456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:58.950117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c53b9-faac-474f-bdf6-83ee3a477165 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:58.965457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 328/661] 10.222.0.61 () {56 vars in 1137 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:58.966772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:58.986572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:58.988052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:58.988639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:58.989016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.060543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.088606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b628a8-2252-4f76-bcd1-7120c9c2a48b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.089727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.092344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.126495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.127234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.127687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.128021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.136106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.137860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:07:59.150847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:59.151756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:07:59.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:07:59.161418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 329/662] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:59.161418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.210868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.240971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 334/663] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:59.242093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.287444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82671a5-98ac-48a0-b6d8-a9a4875defc2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.329095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.330413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.330413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.330610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.330830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.352552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3776b7-2c46-41cf-89d3-00177f8eeaf5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.391152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.391966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.392314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.392733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.393638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:59.393953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.395413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.406070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.407522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893830dc-0f84-4c76-b86a-bedac0571478 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.413557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 335/664] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:59.413557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.470167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.533894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705f236-de21-4726-8d66-dfd27944cc4c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.534647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 330/665] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:07:59.536066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22553-78f9-46a0-8d5f-836743650438 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.536349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22553-78f9-46a0-8d5f-836743650438 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.536617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22553-78f9-46a0-8d5f-836743650438 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.538071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 331/666] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:07:59.538603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b22553-78f9-46a0-8d5f-836743650438 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.578678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.579567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.580106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.580538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.590176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.593053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.596318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:59.611838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:59.612886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:59.613838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:59.613838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:59.613838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:59.613838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 336/667] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:59.613838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.660849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b22553-78f9-46a0-8d5f-836743650438 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.703191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.703793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.704066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.704332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.705056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=e5b1a97a2fad45899863619a3953e0c2) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:07:59.705359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.706809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ea985-25db-437b-882c-fb35eb930289 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.713632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 332/668] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/role_assignments?user.id=e5b1a97a2fad45899863619a3953e0c2&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:07:59.714841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.715118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.715385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.728764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.735123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:07:59.737901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:07:59.751313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523b2a-d991-48b4-abc4-af45e4d5c6cd None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:07:59.794766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:07:59.795734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:07:59.796304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:07:59.796748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:07:59.811403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:07:59.813194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:07:59.816071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 333/669] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:07:59.817141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:07:59.830970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:07:59.832042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:07:59.832933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:07:59.832933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:07:59.832933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:07:59.834980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 337/670] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:07:59.842495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:07:59.938232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:07:59.974817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d420-dc53-4a16-a7d4-db6fa7b2da97 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.021794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.022506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.022905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.023279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.024060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.024490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.025031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f4b9b-5378-45f5-8c0c-1b3f5300d8d0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.026506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.029081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.046069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 334/671] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.054388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.070605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.071240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.071514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.071803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.072526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.072826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.074226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.087438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 338/672] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.093456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.169918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea3c6a-75d1-4512-9fff-bc33e4b0cbf9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.208338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bec69-8e4a-4a6d-9276-ecef73a07990 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.212194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.216349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.216995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.217343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.217796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.227339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.229317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:00.243525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:00.244491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:00.245382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 335/673] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:00.245925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.269632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.270292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.270577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.270852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.283668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.285455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:00.301210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:00.303213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:00.304365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:00.309444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 339/674] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:00.309444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.318144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.370593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47602610-b558-4b3f-96e9-4e60a3455c75 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.408799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.409489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.409719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.409993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.422123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:00.428890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:00.429921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 336/675] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:00.436871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.468155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13657571-07e4-4faa-8e6a-4e342a105069 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.504686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.505296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.505617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.505891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.506590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.506895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.508517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.522009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 340/676] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.522839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.550595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.570606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e773-0348-4fb3-989b-664ee94f1a74 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.594304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.614231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.615283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.615768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.616354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.617255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.617846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.619700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.638363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e9e96-d24d-43ad-ab3b-bcb91bed8097 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.638791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 337/677] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.640024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.674138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.674699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.674982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.675291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.675968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.676267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.677787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.693446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 341/678] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.693446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.795566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:00.795983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c22518-6f1c-46a7-ae1f-313766cd6238 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.814324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7d685-55bf-422d-bbae-0dc3f2242638 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:00.834415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.835020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.835305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.835576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.836302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=5340cd7471884cc2b5a584d7e435d447) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.836672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.838136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.849427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 338/679] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/role_assignments?user.id=5340cd7471884cc2b5a584d7e435d447&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.849427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:00.860109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:00.860730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.861005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.861653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.862565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=24b6f745fb3e4451b182536941eb21d7) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:00.862871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:00.864355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18d610a-1b9a-4c32-805e-d0fa984fa19a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:00.871819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 342/680] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/role_assignments?user.id=24b6f745fb3e4451b182536941eb21d7&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:00.873169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac8c1-f0f4-47cc-8d9d-4cb1fda03456 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.873472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac8c1-f0f4-47cc-8d9d-4cb1fda03456 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.873745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ac8c1-f0f4-47cc-8d9d-4cb1fda03456 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.875305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 343/681] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:00.881069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:00.881533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:00.881895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:00.918854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:00.920278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:00.944423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:01.067006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 344/682] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 27 02:08:01.073577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c2926-13b3-4741-b3ec-372ef6873093 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:01.110401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:01.111054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:01.111337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:01.111613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:01.125346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:01.126888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:01.143212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:01.144284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:01.145162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:01.145162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:01.145162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:01.146115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 339/683] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:01.150971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.242078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:01.262236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc1fe-0421-4ede-9d4b-4f1dd289b4f0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:01.298372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:01.298983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:01.299263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:01.299537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:01.300187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:01.300492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:01.301901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:01.321490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 345/684] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:01.322952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.449423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:01.467682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd915c-168b-4203-96bd-d8d41fe83613 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:01.514149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:01.514788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:01.515065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:01.515333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:01.528879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:01.530347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:01.545040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:01.546084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:01.547054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:01.550858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 340/685] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:01.552245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.619278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.748489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680eef4c-f7a7-407e-af7e-1f263ddfc5fe None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:01.791992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ce4e4-3b87-4813-a4bb-9afd39581348 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:01.810255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:01.810915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:01.811196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:01.811463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:01.812206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:01.812504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:01.813972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:01.834561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:01.853423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 346/686] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:01.857298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.860424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:01.861291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:01.861772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:01.862323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:01.882234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:01.887822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:01.888745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:01.889665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:01.896817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 341/687] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:01.898359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:01.921317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.015117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171145ef-aa0e-457c-9e61-b2a9461dc6cc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.031171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48bfc-7a9c-4158-9b85-7055574d524c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.050575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.051186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.051466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.051735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.069008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.070002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.070493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.071103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.072022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:02.072545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.074270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac05a23-33d7-4ec7-b81f-da31fed6ec0c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.087799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 342/688] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:02.089379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded61d-0714-4dcb-be25-7854902bd13c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.089931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded61d-0714-4dcb-be25-7854902bd13c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.090411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ded61d-0714-4dcb-be25-7854902bd13c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.092255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 343/689] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:02.093217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ded61d-0714-4dcb-be25-7854902bd13c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.124638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.128348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.129897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd138a-bf08-4abb-99d3-d6df79e6758c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.174153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.202342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ded61d-0714-4dcb-be25-7854902bd13c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.240557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 347/690] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 27 02:08:02.240557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.240557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.240557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.242599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.243623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.244100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.244583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.256347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.257111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:02.258448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.258558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:02.273567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:02.274636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:02.275858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:02.275858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.275858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:02.282419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 344/691] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:02.283517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.331289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 348/692] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:02.337923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.385424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.396562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c5291-1f96-4d6f-9efa-d630c346e62a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.423546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.434044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.434610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.434888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.435161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.461702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.463182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:02.491346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:02.492375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:02.493364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:02.493364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.493364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:02.496134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 345/693] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:02.500024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.529186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6866c0-9310-465a-8295-df7e48de15df None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.593098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.594093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.594905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.595635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.596670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:02.597188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.598843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.617745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 349/694] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:02.619630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.717282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a7a45c-cc9f-4997-89ed-9b4e8c4beec8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.732784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.746950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c011-311c-421f-a6cb-0c74af2f66f4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.764838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.765707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.766027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.766377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.767336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:02.767687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.769753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.791435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 346/695] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:02.791435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.792983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.794865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.795388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.795892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.805732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.807816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:02.822482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:02.823490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:02.824483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:02.832085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 350/696] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:02.832085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.849796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:02.912729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3b987-eb06-45c0-8aba-6b827dfc0790 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.950773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.951784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.952314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.952806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:02.958040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298b1d-a1b3-4cf7-bd6e-480cfc4ba483 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:02.966140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:02.968030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:02.984526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:02.985627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:02.986610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:02.986610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:02.986610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:02.993497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 347/697] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:02.993881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:02.997976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:02.999197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:02.999197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:02.999374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.006493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.008069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:03.021990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:03.022930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:03.023849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:03.029379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 351/698] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:03.030589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.047550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.110069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.125748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad08ee-816f-4a0c-a2d4-3b84cf04c463 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.175741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.176981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.177494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.178358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.179571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:03.180076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.181136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836030-27ea-4fbb-81fa-e07a3970a5b0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.182401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.211111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 348/699] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:03.211111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.228210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.228717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.229000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.229272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.229947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:03.230256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.231628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.244458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 352/700] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:03.246555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.324309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.352734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b636c-6058-4711-993c-8f8b2a015b6a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.367582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223b7ac-8f16-4402-bb27-6dedefa49cde None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.398697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.399683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.400025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.400785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.401593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:03.402053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.403587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830cb55-14dc-449a-88a2-fab67486b953 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.411286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.411906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.412185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.412459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.420104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 349/701] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:03.421924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d2b1-98d0-4e3c-8352-0c5744509110 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.422350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d2b1-98d0-4e3c-8352-0c5744509110 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.423160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657d2b1-98d0-4e3c-8352-0c5744509110 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.429524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 350/702] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:03.430761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657d2b1-98d0-4e3c-8352-0c5744509110 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.445761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.495973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.497328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.565201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657d2b1-98d0-4e3c-8352-0c5744509110 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.566491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.599355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.599967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.600245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.600518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.601164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.602705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a681e49-77bd-4f1e-a985-176a3e34ba30 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.602805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 353/703] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:08:03.603859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.623805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 351/704] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:08:03 2022] POST /identity/v3/users => generated 254 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:03.625034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ffafd-a9b9-4c48-8460-abd03878f35c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.625324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ffafd-a9b9-4c48-8460-abd03878f35c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.625627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ffafd-a9b9-4c48-8460-abd03878f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.655065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0a6ffafd-a9b9-4c48-8460-abd03878f35c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:03.657434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0a6ffafd-a9b9-4c48-8460-abd03878f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:03.729815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.743969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 352/705] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:03.746796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da77e-7361-44a1-830d-0bed1a7ec267 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.747295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da77e-7361-44a1-830d-0bed1a7ec267 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.747762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5da77e-7361-44a1-830d-0bed1a7ec267 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.748602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f7d7d-8ead-427b-bd12-4f9dea47b2e7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.753881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 353/706] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:03.754568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5da77e-7361-44a1-830d-0bed1a7ec267 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:03.798820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.799510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.799985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.800283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.802821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=6e7b457718554fac8c6e8fefea700674) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:03.802821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.803761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d1969-4e7b-4f6f-ad2b-72468f79abb3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:03.811406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 354/707] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:03 2022] GET /identity/v3/role_assignments?user.id=6e7b457718554fac8c6e8fefea700674&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:03.813892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.813892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.813892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.839001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:03.840602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:03.874996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:03.922076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5da77e-7361-44a1-830d-0bed1a7ec267 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:03.943808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 355/708] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:03.971370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:03.972022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:03.972352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:03.972625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:03.984501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:03.986029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:04.007576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:04.008796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:04.009916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:04.009916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:04.009916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.009916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 354/709] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:04.016430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.071160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.131586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.148339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12058-86b2-4e8c-aa0c-48d0836bbfe4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.196036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.196700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.196911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.197181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.197862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:04.198162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.199605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.201864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a55746-5121-4cd2-aefc-335bd8e30aa0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.217432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 356/710] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:04.219136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.252942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.256273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.256273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.256273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.256273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.257896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.259984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:04.284065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:04.285770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:04.287023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.290807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 355/711] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:04.290807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.371536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec1f3-38aa-4ac9-8ffb-65113bf180c9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.418481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed9c8d-440e-4c9b-8154-4c7fb09f78d2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.421614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.422293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.422567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.422833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.432956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.434712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.437795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:04.453989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:04.454944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:04.455914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:04.463060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 357/712] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:04.463060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.465759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.466514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.466693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.466924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] PATH_INFO: `/v3/services/network` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.467510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.469008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:04.479107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:04.480145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:04.480990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 356/713] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:04.486071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.573654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.592162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269dc44-d49e-4be4-a5ec-f0e252e65a3f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.599440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c69555-3950-4b09-91d0-d6b4ca5a1da3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.629043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.629692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.629968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.630242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.630928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:04.631270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.632805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.644877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.645661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.646124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 357/714] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:04.647021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.649696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.649977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.650922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:04.651251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.652659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.658148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 358/715] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:04.659008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.697512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.780130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc011c87-87c6-4659-a6c7-30299fea0b2f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.790833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48afed3-cd8a-4060-b076-58da78a755cf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:04.835247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.835774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.836048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.836337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.837367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:04.837512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.838972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.849638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 359/716] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:04.849638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:04.865754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:04.866384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:04.866660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:04.866926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:04.867767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] RBAC: Adding query filter params (name=network) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:04.868172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:04.873421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:04.876581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:04.888014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 358/717] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:04.889116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:05.061861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ae9dd-188e-4a09-823e-9eda5ed9cf73 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:05.079800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:05.088648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866da2f2-e656-4f4b-a573-ff245449cb3d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:05.109552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:05.110537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:05.111167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:05.111642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:05.112577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:05.113117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:05.114934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9423f-502b-4ea5-be92-55fcf72fb191 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:05.121779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 360/718] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:05.151765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:05.152770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:05.153278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:05.153837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:05.154776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] RBAC: Adding query filter params (type=network) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:05.155335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:05.156976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c365d3-ddfd-4508-afb3-f8f85f03085e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:05.171442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 359/719] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:06.215803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762223-c554-4033-b6fb-091782c53aea None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:06.216368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762223-c554-4033-b6fb-091782c53aea None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:06.216368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762223-c554-4033-b6fb-091782c53aea None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:06.218026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 361/720] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:06.223572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:06.224004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:06.224204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:06.246469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:06.248082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:06.316991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde7b3-bec7-47c0-97d6-f88a6ceda341 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:06.317318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde7b3-bec7-47c0-97d6-f88a6ceda341 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:06.317618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fde7b3-bec7-47c0-97d6-f88a6ceda341 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:06.319093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 362/721] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:06.324344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:06.324608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:06.324886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:06.348433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:06.350695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:06.356892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 360/722] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:06.437173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 363/723] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:06.714266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:06.747556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:06.752889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:06.828293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:06.852310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e04a-1b3a-41c2-bdd0-4ee5d4874883 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:06.896178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:06.896811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:06.897082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:06.897344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:06.921568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:06.927635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:06.928627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:06.929493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 361/724] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:08:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:06.938364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:06.967411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd7715-7a7d-4d3d-88b5-d2c2c0644daa None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.069380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.070512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.071230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.071888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.090143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:07.100325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:07.101293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:07.102209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:07.107035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 364/725] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:07.113809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.123973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2197b-6189-46ba-859c-d20535ffd2c3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.162127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.165897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.166385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.166847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.167709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:07.168396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.170016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda3a2c-d4f6-41bb-aa05-54b3b58685a3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.183491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 362/726] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:07.189824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d285c-93f1-4a0c-af5a-2dda9cbc3f66 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.190113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d285c-93f1-4a0c-af5a-2dda9cbc3f66 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.190391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d285c-93f1-4a0c-af5a-2dda9cbc3f66 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.195647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 363/727] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:07.195647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d285c-93f1-4a0c-af5a-2dda9cbc3f66 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.216923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.234885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.276321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb55143-5ed0-445a-9d76-6bd6a292a1f5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.322631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.324073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.324718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.325283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.326411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:07.326923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.329138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca5ddc-1620-4283-b01b-832723106b55 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.338127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d285c-93f1-4a0c-af5a-2dda9cbc3f66 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.342540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 365/728] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:07.344016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.344497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.344981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.369793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:07.371634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:07.377425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.378074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.378351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.378621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.389900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.391398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:07.408792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:07.409861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:07.410750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:07.410750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:07.410750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:07.414657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 364/729] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:07.415526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.465420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 366/730] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:07.465420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.536578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.555813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.597323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430a4c5-6ec7-4c3c-8939-97c526b8f58e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.623891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae08f07-0ef8-44a5-b631-ddb31d28661a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.639171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.639837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.640117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.640388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.652307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.653763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.668671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.669604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e61caee2-267e-4f01-8c29-50ba64ec18e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:07.669729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:07.670612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:07.671487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:07.671487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:07.671487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:07.672375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.672851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.673710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:07.674202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.675660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 365/731] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:07.676003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db41ec-054e-4f22-9c51-a16d1d38adf2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.676969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babbf-7072-488c-9a64-95cd64c17088 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.677258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babbf-7072-488c-9a64-95cd64c17088 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.677557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73babbf-7072-488c-9a64-95cd64c17088 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.683182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 366/732] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:07.683182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73babbf-7072-488c-9a64-95cd64c17088 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.696059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 367/733] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:07.697774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9116-ea36-41c4-ab64-5dcdb8a7c832 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.698279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9116-ea36-41c4-ab64-5dcdb8a7c832 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.698613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f9116-ea36-41c4-ab64-5dcdb8a7c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.716500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-252f9116-ea36-41c4-ab64-5dcdb8a7c832 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:07.717717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-252f9116-ea36-41c4-ab64-5dcdb8a7c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:07.788987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 368/734] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:07.790185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da0b3-dbf9-4dfd-b103-1d3576a4ad70 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.790528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da0b3-dbf9-4dfd-b103-1d3576a4ad70 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.790901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84da0b3-dbf9-4dfd-b103-1d3576a4ad70 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.792134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 369/735] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:07.792821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84da0b3-dbf9-4dfd-b103-1d3576a4ad70 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.801199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73babbf-7072-488c-9a64-95cd64c17088 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.822399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.842686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.843417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.843789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.844160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.844915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:07.845381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.846850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.852712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:07.859680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 367/736] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:07.860656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:07.916605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84da0b3-dbf9-4dfd-b103-1d3576a4ad70 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.956220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:07.957105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.957590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.958007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:07.965960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:07.967474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:07.979183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26117c-aa8e-436e-8ed4-b5ae53b68375 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f4e8a6ec-befd-4d26-afe4-46dde206cd45 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:07.980796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:07.982411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 370/737] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:07.991221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:07.992287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.009673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:08.011464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:08.026827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.027594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.027964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.028239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.038924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:08.043779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:08.044850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 368/738] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:08.046332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.085956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.093327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 371/739] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 27 02:08:08.094094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.130152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.158301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259802d-67b4-4647-a136-a0469e89b81f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.199040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.200420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.200800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.201428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.203228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89f45f-af66-4a41-913d-0ce9922da1a6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.210107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.212259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:08.229033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:08.230218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 369/740] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:08.236263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.239535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.240151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.240428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.240725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.241451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:08.241784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.243237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.261759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 372/741] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:08.263155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.355777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.360030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5834f-aeb1-4d5b-b960-54a28d066002 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.383684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.393694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e0bc5-d531-409f-b2fc-a97b9168eea5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.397580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.398452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.398452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.398768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.399440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:08.399740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.401448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.410134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 370/742] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:08.410923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.431145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.431753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.432028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.432293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.432952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.434369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.451131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 373/743] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:08 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:08.452410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.528213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb85ef-66cf-479b-9f52-ac646883caf8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.581032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.581691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.582021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016ac7f-5482-41a3-bc58-119f0069f035 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.582121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.582287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.582967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:08.583274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.584745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.606116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 371/744] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:08.607021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.624276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.626148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.627181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.627690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.628453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.650353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.704797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.706386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.721329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b41150-5966-4897-bb76-c406d8722cb2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.765451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.766455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.766944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.767415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.768286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:08.769906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:08.787219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 372/745] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:08 2022] POST /identity/v3/services => generated 240 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:08.788875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.819092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 374/746] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 27 02:08:08.819948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:08.879843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.907291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:08.951764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08f9f-37e1-44a7-84b1-26bf1a709f95 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.954705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f1ea-ebb1-4250-b39f-830ccdf2a3ed None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:08.993799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.994857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.995333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.995856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:08.998663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:08.999283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:08.999568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:08.999838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.008932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.010442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:09.029113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.030271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:09.031173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:09.031173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.031173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.031173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 373/747] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.032123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.079454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.080954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.137603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.185537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28a1f43-f273-4393-81fb-b4e7c57aafdf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.198196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 375/748] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:09.199115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.211258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.223667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.224417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.224668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.224940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.238043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.239587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:09.254625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.255783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:09.257062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:09.257062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.257062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.257062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 374/749] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.257062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.310498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a22a9e-d851-4e3d-a7b1-a40d400b46a5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.351464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.352386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.352810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.353226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.354168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:09.354702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.356235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.364211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6e6b5-a0c4-4c86-9b84-653c6b0f445d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.370187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 376/750] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:09.371360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.385633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.401982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.402546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.402825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.403097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.415085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.416515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:09.432081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.433112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:09.434615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:09.434615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:09.434615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.434615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 375/751] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.434615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.463791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.490840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775cb1a-9b2d-47a2-928f-beecd78d53c6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.527718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.528735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.529228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.529773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.530613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:09.531113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.532943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.542125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214dab-ddc8-4e54-9230-ef33666ac848 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.547592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 377/752] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:09.548774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.582678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.583313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.583736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.583953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.593155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.594990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:09.607879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.608900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 376/753] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.610523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.629945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.665953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca981a-b52f-418c-84e5-15ffa519d9de None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.702147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.703164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.703641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.704168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.705336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.706235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:09.706753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.708454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.719896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23de0e69-e715-4dd4-b471-08d9ecce4925 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.722746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 378/754] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:09.723918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.755674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.756348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.756623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.756890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.764133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.765602 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:09.777928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.778932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 377/755] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.780238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.838533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e413-36a4-4f7a-af8f-0fce62c7ee27 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.870188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:09.877124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.878037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.878518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.878986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.880062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:09.880661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.882328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.889263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2335bb-fded-4a15-ad4b-73ffd53e05e7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:09.902458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 379/756] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:09.903869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.926071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:09.926627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:09.926903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:09.927175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:09.934679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:09.936326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:09.948503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:09.949469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 378/757] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:09.950786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:09.960369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.018076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5dd32-56b5-4a84-821b-286e584ca600 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.055694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.056732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.057214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.057625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d4e9c-a0d6-483d-8014-3085d8223044 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.057954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.058869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.059439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.061186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.074501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 380/758] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.075907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.094107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.094747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.095062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.095376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.107689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.108956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:10.124071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:10.125047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:10.126579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:10.126579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:10.126579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:10.126579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 379/759] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:10.126579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.133224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.190214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58072a-0cfd-4429-b895-4c954802afce None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.191481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.228531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.229727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.230223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.230693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.231599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.232151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.234099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.235633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d89c1-5a15-4bfa-8891-b6fe26575c26 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.249387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 381/760] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.251200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.271905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.272556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.272832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.273143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.274023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.274328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.276069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.282439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 380/761] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/role_assignments?user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.283182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.369811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fcc19-2e10-4e9d-aa9d-8f69fc8377ac None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.382830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.397082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73d7e-2be5-48ae-8748-270fbd124f8b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.412365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.413514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.414005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.414540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.415452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.415963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.417765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53b27a-cf32-4c57-b58f-261de8857220 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.423750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.435045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 382/762] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.436739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.437057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048560-8533-4044-a522-b88256ddbd9b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.437350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.437657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.437926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.438200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048560-8533-4044-a522-b88256ddbd9b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.438667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=6e7b457718554fac8c6e8fefea700674) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.438783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53048560-8533-4044-a522-b88256ddbd9b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.438961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.440533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6c948-0414-4e76-8c76-fc642926a827 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.441467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 383/763] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:10.442829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53048560-8533-4044-a522-b88256ddbd9b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.447249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 381/764] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/role_assignments?user.id=6e7b457718554fac8c6e8fefea700674&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.448682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.449018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.449292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.470896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:10.473536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:10.577748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 382/765] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:10.626868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53048560-8533-4044-a522-b88256ddbd9b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.664797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.665450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.665727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.665993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.673268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.674748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:10.687202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:10.688135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:10.689708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 384/766] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:10.694250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.847297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd98044-864f-43bc-8feb-b8a835d19a30 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:10.873181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:10.898285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:10.899015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:10.899302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:10.899574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:10.900592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:10.900700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.900897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:10.902512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:10.926006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 383/767] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:10.932535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:10.958070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:11.092821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba972cda-3e1c-4922-b4b5-256b44697cd9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.114117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82381015-a6e9-4ec9-9a5f-b8e89cc68339 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.131414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.132345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.132763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.133308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.134257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:11.136430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:11.154851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:11.155926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:11.157114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:11.157958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.157958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.157958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.157958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.158224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 385/768] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Aug 27 02:08:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:11.165042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=9ddf36f45acc45fe99073dec8c3ee497, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:11.165241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:11.166917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:11.181899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 384/769] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:10 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:08:11.329959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:11.339476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062765f2-4552-4649-b0ea-49bf9dc7a175 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.381365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.382038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.382282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.382511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.383181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:11.383480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:11.384906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99dda-ef9e-4e40-b0b5-bc3cf522a81a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:11.390290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 386/770] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:11.395890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:11.437058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:11.519192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a36b27-e98e-4991-bf60-874d793adebd None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.552949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815d39c-311c-44d6-80a0-5a0c60a952b2 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.553309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815d39c-311c-44d6-80a0-5a0c60a952b2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.553510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815d39c-311c-44d6-80a0-5a0c60a952b2 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.556294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 387/771] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:11.562558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.562845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.563119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.576870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.577506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.577869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.578137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.578776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:11.579075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:11.580509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:11.583912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:11.585124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:11.589895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 385/772] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:11.595719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:11.720347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 388/773] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:11.743452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:11.747433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80ca4-b0c7-4c9d-9b09-38d00846cf3e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.789612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.790223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.790500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.790767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.791468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] RBAC: Adding query filter params (interface=public, service_id=e342a1315b97429ca25c134580a1ea63, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:11.791769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:11.793142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:11.801076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 386/774] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:11 2022] GET /identity/v3/endpoints?service_id=e342a1315b97429ca25c134580a1ea63&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:11.806974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:11.934497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:11.952340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e9d70-4c55-4fb3-838a-92fdfeb694a4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:11.996296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:11.997206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:11.997686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:11.998125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:11.998892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:12.000734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:12.006754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 389/775] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:11 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:12.238947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:12.350197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546e80-2aec-4629-a5a3-0841771f9a8a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:12.403029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:12.403676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.403963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.404236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] PATH_INFO: `/v3/services/network` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.404833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:12.406240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:12.421031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:12.422100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:12.422941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 387/776] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:12 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:12.428302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:12.598396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1bd23-d0cd-47d1-8d69-ab9425859736 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:12.641059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:12.641945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.642360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.642787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.643595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:12.644029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:12.645560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5eab47-0cec-4f46-b7eb-a9fb94052ee0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:12.651079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 390/777] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:12.662600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:12.699637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a865b21-cc7b-40c9-be54-80693bcc6f92 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.700174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a865b21-cc7b-40c9-be54-80693bcc6f92 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.700590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a865b21-cc7b-40c9-be54-80693bcc6f92 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.702475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 391/778] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:12.708012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f61e63-1b59-4c2c-8194-50c4af50c914 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.708553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f61e63-1b59-4c2c-8194-50c4af50c914 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.709014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f61e63-1b59-4c2c-8194-50c4af50c914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.710922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:12.730161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b6f61e63-1b59-4c2c-8194-50c4af50c914 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:12.731829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b6f61e63-1b59-4c2c-8194-50c4af50c914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:12.742762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:12.791524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a25d0-ca72-489b-8f19-8639dcba827f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:12.803580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 392/779] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:12.810945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b09b8-1c75-419a-9555-6c463399fff9 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.811647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b09b8-1c75-419a-9555-6c463399fff9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.812136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b09b8-1c75-419a-9555-6c463399fff9 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.814004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 393/780] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:12.819660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.820176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.820743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.840815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:12.841443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:12.841722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:12.841985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:12.842615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] RBAC: Adding query filter params (type=network) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:12.842910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:12.844262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:12.851397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:12.852567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:12.856633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 388/781] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:12.862421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:12.976257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 394/782] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:13.013985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.021261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e878c94-9785-4be4-bdd0-45d7c8fdfe81 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.065679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.066349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.066629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.066904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.067658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] RBAC: Adding query filter params (interface=public, service_id=c1a96cc311844f9f8e3810f1b0911a73, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:13.067969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:13.069339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:13.077597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 389/783] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:12 2022] GET /identity/v3/endpoints?service_id=c1a96cc311844f9f8e3810f1b0911a73&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:13.083118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.161156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.165937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.202535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f14be4-a557-44a9-9c6c-741eb6299421 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.265275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.266259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.266727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.267210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.268042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:13.269644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:13.275842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 395/784] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:13.330215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.343242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea138d04-ff09-4b63-b609-e4599ce49204 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.405808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.406708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.407124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.407529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.434992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:13.440271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:13.441261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:13.442134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:13.449741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 390/785] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:13.457091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.488868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339e242-2639-4e16-b560-e40921331bfd None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.489780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.531864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.532885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.533493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.534059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.545294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.551385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:13.557520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:13.558637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:13.559498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:13.562447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 396/786] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:13.568658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.591839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f271a1cf-1860-4a6f-9204-f9f4bd5c2ae0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.632409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.633071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.633348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.634494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.635166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:13.635531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:13.636896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4e72d-f258-44a6-8b0a-55fac983e5b2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:13.646688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 391/787] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:13.650368 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f481-6ba6-4cb8-ac7a-1de72dafe4dc None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.650897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f481-6ba6-4cb8-ac7a-1de72dafe4dc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.651378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1f481-6ba6-4cb8-ac7a-1de72dafe4dc None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.653051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 392/788] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:13.654750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1f481-6ba6-4cb8-ac7a-1de72dafe4dc None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.701875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626770-08c2-4227-8769-1ed26b2270cc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.742832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.743831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.744452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.745039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.745865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:13.746241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:13.747796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cadc8e-a3ce-43da-976c-b9e186f7e1e2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:13.757774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 397/789] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:13.759348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.759762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.760161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.774405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.782088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:13.783525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:13.802357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1f481-6ba6-4cb8-ac7a-1de72dafe4dc None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:13.840580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:13.841650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:13.842100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:13.842509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:13.854612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:13.856456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:13.864617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:13.874458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:13.875456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:13.876437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:13.876437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:13.876437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:13.877193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 398/790] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:13.878074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.878999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 393/791] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:13.887185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:13.998215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfead8-3005-4594-be48-207492f64fbc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.011528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd1cf0-1683-4aea-a008-40d21f385961 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.044823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.045049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.053435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.053435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.053435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.058791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.060266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:14.075931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:14.076896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:14.077814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:14.077814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:14.077814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:14.077814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 399/792] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:14.078639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.079260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.079526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.079796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.080450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.080748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.089439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.090520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.108838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 394/793] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:14.115290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.189965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.241971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df550a3f-e607-473e-bdb4-b51bb054759a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.263309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfae486-ed73-4639-b45f-12ae2db2e277 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.277121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.277888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.278238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.278579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.286051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.287608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.299559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:14.300042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:14.300930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:14.301916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:14.302450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.302450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.302450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.302450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.302685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 395/794] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:14.305836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.307860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.308994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.326884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 400/795] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:14.328280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.361562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.413972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c96b-e1f4-495b-9d37-0e913aef0aa1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.433497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef6d35-2869-4475-ba2f-8a7b5dc105d0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.435223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.452917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.453542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.453819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.454085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.454812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.455113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.456563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.471548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.472186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.472466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.472742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.480331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 396/796] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:14.480331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.484056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f3e938d7-e553-4c7d-bc33-238b42b7b6aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:14.488888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:14.490307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:14.491200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 401/797] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:14.491888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb5fc-3777-4f99-b28e-472bdc9badc9 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.491888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb5fc-3777-4f99-b28e-472bdc9badc9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.491888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdecb5fc-3777-4f99-b28e-472bdc9badc9 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.498687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 402/798] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:14.498687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb5fc-3777-4f99-b28e-472bdc9badc9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.584001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdeca65-a9a6-42be-a10f-e9c75f4b540b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.596473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.610008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdecb5fc-3777-4f99-b28e-472bdc9badc9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.624530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.625167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.625465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.625736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.633647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.635700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.644327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.644961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.645242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.645551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:14.648246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:14.649571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:14.651142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:14.654613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 397/799] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:14.655232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.660519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.662140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-946573c3-274e-41ce-a936-4358e37712b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:14.679372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:14.680384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 403/800] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.686320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.702781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:14.704479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:14.716112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.760144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89d106e-d306-4279-97de-e9167c4f09bc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.789422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 404/801] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:14.789422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.806073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.806684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.806964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.807234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.807899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.808196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.809712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.823300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 398/802] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:14.823300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:14.854961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:14.923547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004f555-fee8-45b9-8255-0caa32a5a2bd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.928833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb1a4b-f17f-4d92-9925-d4dfb4b84aa8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:14.964882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.965535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.965868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.966123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.966782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.967074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.968443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.969364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:14.970537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:14.971540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:14.972004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:14.972918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:14.973426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:14.975109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:14.985491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 399/803] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:14.986388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.001928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 405/804] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:15.003526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.008370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.086897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.097300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bbe6b1-4ea2-4678-b684-59f6f80d2603 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.128927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7f05f-0aa9-4b05-bbf8-15f92ff16c9b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.131657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.132292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.132570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.132849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.144098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.145592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:15.160448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:15.161471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:15.162414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:15.162414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:15.162414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:15.162414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 400/805] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:15.162414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.171387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.172023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.172284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.172578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.180318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.181668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:15.194725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:15.195680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:15.196576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:15.200692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 406/806] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:15.201538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.270501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.283649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f063baa-dac1-4eb2-a1ac-606e39877e12 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.315480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae61f0d-2f4c-4dfa-9f6e-7a1a2bd2a474 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.325372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.326064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.326328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.326597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.337450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.338883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.340756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.353491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.354127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.354401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.354657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:15.354827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:15.355715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:15.361769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:15.361769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:15.361769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:15.361969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.362050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 401/807] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:15.362127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.362197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:15.372283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:15.373291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:15.374186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 407/808] 10.222.0.61 () {56 vars in 1129 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:15.374993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.471487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf8f01-2b67-4d75-87ab-1bdb1b5bab77 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.477179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c778-38ca-45ca-88a9-7c1c5249bc98 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.504189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.508739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.509426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.509658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.509930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.510574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:15.510876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.512288 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.515857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.516459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.516732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.516997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.517765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:15.518064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.520003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.528950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 402/809] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:15.528950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.534695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 408/810] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:15.535354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.584443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.631898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fe4c3a-0e82-4cb7-9e01-aefcf61dc3ea None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.637895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc64d33-238d-4e46-b03c-bb84b8608418 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.666147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.666891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.666891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.666891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.668318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:15.668764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.670151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78f97c-3a81-41e3-ad35-ba30a4912121 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.673288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.673917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.674192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.674458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.675140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:15.675476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.676704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.682000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 403/811] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:15.682696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 409/812] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:15.683582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.683790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394cde-458c-45f6-bde8-f2409c86d928 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.683939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394cde-458c-45f6-bde8-f2409c86d928 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.684221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4394cde-458c-45f6-bde8-f2409c86d928 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.685445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 404/813] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:15.686112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4394cde-458c-45f6-bde8-f2409c86d928 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.737493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.787999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239a33f-f939-4fdb-bf93-ef9f60645757 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.791358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4394cde-458c-45f6-bde8-f2409c86d928 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:15.805635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:15.822633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.823259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.823531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.823797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.827398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:15.828045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.828320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.828591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/6e7b457718554fac8c6e8fefea700674/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.830478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=6e7b457718554fac8c6e8fefea700674, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.830987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:15.831891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.832417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-1fbcd92a-4ab3-4bc7-b4e0-72883462bf7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:15.844407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:15.845659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:15.846827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:15.849478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 405/814] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:15 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/6e7b457718554fac8c6e8fefea700674/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:08:15.850375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 410/815] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:15.850711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.851707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:15.852018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:15.852291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:15.872448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:15.873717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:15.953463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 411/816] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:15.953463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:15.977473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77ad25-90f3-418b-841a-0a2233fe8d5c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.004120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.024017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.024780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.025456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.025837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.034088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.035756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:16.052128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:16.053822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:16.054874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:16.056571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 406/817] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:16.057541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.082082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d6f38-ddee-4c52-b6d2-5bb0396bcdb6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.094375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.168264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b26ef-7a8e-4947-8b34-535b8497bd40 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.205111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.206012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.206540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.206944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.207838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:16.208280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.209911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.229851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 407/818] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:16.230917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.266402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.266917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.267189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.267458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.268079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:16.268376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.269762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.277945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 412/819] 10.222.0.61 () {56 vars in 1124 bytes} [Sat Aug 27 02:08:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:16.277945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.337845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.351021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380cd148-e36f-42fd-8f18-b6ede42fcd2e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.384677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f82405-26fa-4bfe-8936-f9280993af5d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.387000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.389836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.390451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.390729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.391007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.391698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:16.392002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.393866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.411972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 408/820] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:16.413080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.422395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.423053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.423332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.423599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.424185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.425678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:16.434937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:16.435929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:16.436752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 413/821] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:16.437603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.523622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25a66a-4ef1-43e4-badd-e936c1b324d3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.543343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387975-d4cf-498b-b96a-5b5a94f534c4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.559369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.559974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.560243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.560515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.578107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.578695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.578977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.579227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.579885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.581244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.583636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.604569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 414/822] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:16.605423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.641041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.654515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.656438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.729840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27beb2-9909-412f-90b6-26ac50f11c17 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.778628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 409/823] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:16.779295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.779512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.780344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.780803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.781269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/95fe53e9d4d34a4e9c2d3dcee43c1f65/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.802577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=95fe53e9d4d34a4e9c2d3dcee43c1f65, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.805371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.821203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 415/824] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:16 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/95fe53e9d4d34a4e9c2d3dcee43c1f65/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:08:16.822285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.849375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.900380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:16.906471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d41fe0-81a2-46c2-96bd-c6d7bd227e65 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.937141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac046fa-42b3-4feb-9240-005ba5aba1f0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:16.948644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.949322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.949636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.949909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:16.950556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] RBAC: Adding query filter params (name=network) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:16.950860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:16.952307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:16.959791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 410/825] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:16.970944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:16.985567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:16.986557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:16.987270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:16.987724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.003280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.005276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:17.025325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:17.026565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:17.027667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:17.027667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:17.027667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:17.029898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 416/826] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:17.035848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:17.094982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede35e1-6193-4ee5-bfd7-9a0098b81d5c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.125830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:17.132864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.134405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.134892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.135360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.136642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] RBAC: Adding query filter params (type=network) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:17.137172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.139452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.146936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 411/827] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:17.155542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:17.167100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08adaaf-c016-449b-be83-c67d57aef3b4 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.189637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:17.202631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.203239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.203514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.203784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.204485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:17.204789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.206189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.219025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 417/828] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:17.229208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:17.282206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5883a43b-9ae2-4b16-b7cb-b5e41eddc8fa None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.326997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.328149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.328998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.329500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.330442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.332025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.359596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 412/829] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:17.408626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4e590-48a7-4ed9-8c5e-33d048178063 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.453469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.454660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.455133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.455605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.463582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.465363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:17.478337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:17.479309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:17.480197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:17.482672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 418/830] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:17.488573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:17.527616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:17.599193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfff26-f410-4145-a740-266bf336911d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.636664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.637285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.637596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.637868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.638689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:17.638997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.640453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f3117-0fe5-4c90-8c9a-642c9bebe75e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.653890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 413/831] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:17.660094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:17.702071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:17.764060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74574ec-6a7e-4edf-8a6a-cbf2c7aee08d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:17.798791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:17.799399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.799677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.800010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.800736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:17.801041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:17.802504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4bf492-4fcd-41bc-9e19-a0f74e6c1010 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:17.808727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 419/832] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:17 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:17.877646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cc99-26f4-4151-9a6c-e2b9e4775384 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.878152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cc99-26f4-4151-9a6c-e2b9e4775384 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.878152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3cc99-26f4-4151-9a6c-e2b9e4775384 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.879437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 414/833] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:17.885209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:17.885530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:17.885811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:17.905874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:17.907107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:17.983405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 420/834] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:18.253616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cc99-26f4-4151-9a6c-e2b9e4775384 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:18.357522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:18.364381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3cc99-26f4-4151-9a6c-e2b9e4775384 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:18.398781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:18.399410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:18.399688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:18.400261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:18.411003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:18.415912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:18.416840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:18.417750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 415/835] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:18.422952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:18.457748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:18.529533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb77bd-9e45-4d47-8c51-7560188f23fa None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:18.564681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:18.565701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:18.566172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:18.566656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:18.567533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:18.568027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:18.569627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:18.579492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 421/836] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:18.587698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:18.693770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533fefb-de59-4612-95fc-630de7a13514 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:18.730209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:18.730841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:18.731116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:18.731382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:18.742841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:18.744285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:18.758803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:18.759802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:18.760693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:18.760693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:18.760693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:18.760693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 416/837] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:18.767342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:18.864427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:18.872035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2164f2d-8ac2-49d6-b915-919b188daa3c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:18.907032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:18.907918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:18.908342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:18.908757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:18.909584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:18.910037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:18.911581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1eb82-68f2-499d-bbd6-ddb34551f612 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:18.924632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 422/838] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:18.930517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:18.949745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.037622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7caed-c2dc-4d5d-916a-0bbeffa70812 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.063082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1793-6198-40c0-afc6-ed91c7fa2b81 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.063447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1793-6198-40c0-afc6-ed91c7fa2b81 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.063628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1793-6198-40c0-afc6-ed91c7fa2b81 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.065232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 423/839] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:19.069345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573057-6f51-437a-bff3-b209f24c7d7f None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.069668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573057-6f51-437a-bff3-b209f24c7d7f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.069937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39573057-6f51-437a-bff3-b209f24c7d7f None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.072329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 424/840] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:19.073338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.074908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.075541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.075817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.076081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.076358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.076637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.084603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.085967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.095087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:19.096253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-108cd743-38fe-4840-b1d3-31bd4198b9bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:19.098881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:19.099910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:19.100880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 417/841] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:19.101647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.101647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.103154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.120104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:19.121253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:19.171022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 425/842] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:19.171665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.197147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.206532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 418/843] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:19.262825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.279027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69efc-7467-4c5c-b529-ee6685f83c21 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.315324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.315937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.316212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.316479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.317218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:19.317547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.319559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.337313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 426/844] 10.222.0.61 () {56 vars in 1135 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:19.343123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.444038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a94d4-0cd8-4704-b526-dafdc52982d3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.453973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.479668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.480674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.481370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.481666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.548315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.551766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.553310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.560881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c57d39-84bb-4b6c-a0a4-237c9fb14bff None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.599276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.599909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.600185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.600513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.611624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:19.616542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:19.617792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 427/845] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:19.618646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.621905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.667151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 419/846] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:19.668060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.730827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d119e04-049d-4458-a0f7-e0863110f0cc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.768235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.770839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.771961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.772452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99b907-d003-402e-9b9d-d57d8d68f2ab None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.772566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.772961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.773761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.775572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:19.784792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:19.789787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:19.790679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 428/847] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:19.792032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.865985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:19.906713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c2b1e-e420-47d9-971b-c90086a2ff22 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:19.943804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.944230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:19.944722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.944814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.944886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.945109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.945263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.945660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.946328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:19.946625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.948516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.956212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:19.957716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:19.958715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 420/848] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:19.959538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8300a623-a27e-4276-b87c-909f93920392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:19.978567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:19.979597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:19.980484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:19.980484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:19.980484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:19.980484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 429/849] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:19.981049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855a23a-220d-4c78-b2c4-7a472bef56b4 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:19.981049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855a23a-220d-4c78-b2c4-7a472bef56b4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:19.981635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855a23a-220d-4c78-b2c4-7a472bef56b4 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:19.982523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 430/850] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:19.983213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855a23a-220d-4c78-b2c4-7a472bef56b4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.071209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b544d-45df-4c23-981d-8f744a995c18 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.086073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855a23a-220d-4c78-b2c4-7a472bef56b4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.102939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.105026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.105671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.105947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.106584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.106833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.107128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.108481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.112894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 421/851] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.113697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.121517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.122184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.122462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.122732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.133336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.134809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.139125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-87edd9e2-ff73-4e15-af8d-22fcd2cd3314 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:20.149194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:20.150654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:20.151733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:20.151733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:20.151733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:20.151733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 431/852] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:20.151733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.152071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.152243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.169141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:20.170369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:20.216066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229f8c2-1742-4f43-adb4-354be0bc4dec None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.233855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 432/853] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:20.234602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.251895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.252508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.252789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.253063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.253754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.254058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.255421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.267266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 422/854] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.268061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.348381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.352349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01e0f5-54c1-4add-9c6c-8f4ebbc041e2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.359268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.376715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64d0eb-b968-40a2-aae3-6cd2b9dbce51 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.387229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.387845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.388123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.388400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.389031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.389332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.390740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.395078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 433/855] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.395832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.430271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.431268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.431775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.432944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.434023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.434681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.437102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.455466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 423/856] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.464738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.535103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c5196-fc1c-47ed-90d6-84e98e002177 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.574911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.575543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.575824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.576098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.582943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.583485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02161e-18b5-4922-be3b-2bc318b7b805 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.584382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:20.595548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:20.596449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:20.597337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 434/857] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:20.597852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.624339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.626187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.626882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.627222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.627820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.636567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.638034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:20.649831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:20.651116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 424/858] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:20.652106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.658051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.714628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bec13-030e-4060-b3b4-9f50cbfda677 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.753759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.754392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.754664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.754930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.755518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.756867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.758901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1dcf3-3222-42c1-b230-f20a7c4b1328 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:20.766999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:20.768132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:20.769227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:20.773167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 435/859] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:20.774056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.800921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.801482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.801764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.802034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.802836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.803253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.804756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.818550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 425/860] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.819378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.874786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.885351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:20.889797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3dbf2-2e6b-43a2-95b2-4786731d2a42 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.923055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c49d6e-ee6b-4245-ac95-f01506955ebc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:20.926420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.927019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.927290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.927554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.928275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.928572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.930082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.948601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 436/861] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.949434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:20.966326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:20.966938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:20.967483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:20.967483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:20.968099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:20.968389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:20.969787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:20.974373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 426/862] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:20.975131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:21.062782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb72ce-0dcd-4f7b-9b68-1eae27c220ff None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.083960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef1133-f666-4465-9911-5ec6388b1c76 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.101025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.101694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.101976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.102249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.102975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=6e7b457718554fac8c6e8fefea700674) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:21.103284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.104715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.110415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 437/863] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/role_assignments?user.id=6e7b457718554fac8c6e8fefea700674&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:21.121668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:21.126600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:21.133601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:21.138766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.139395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.139676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.139949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.238077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.239384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f2391-3fb0-4365-8ddc-4828aa571fe3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.239629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.300559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.301662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.302156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.302628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.303446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:21.303935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.305960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.312004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 438/864] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:21.386894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 427/865] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:21.392939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:21.479844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:21.508792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaab668-2f4c-4088-92e4-3673d1756eb6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.543620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.544310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.544593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.544864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.556620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.558777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:21.576019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:21.577011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:21.577931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:21.577931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:21.577931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:21.577931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 439/866] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:21.584166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:21.611836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:21.693667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d629ea-5775-4024-bb95-c9029d6a5092 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.729858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.730916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.731425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.731881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.732728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:21.733215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.734897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.747991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 428/867] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:21.753916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:21.860088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66c700-851d-4d6d-a382-67f04d226790 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:21.886820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:21.896274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:21.896907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:21.897183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:21.897483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:21.904715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:21.906200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:21.917488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:21.918377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:21.919258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 440/868] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:21.926077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:22.017262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:22.033090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a51106-a79a-4b11-aac6-8e8c5a46887c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:22.068653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:22.069664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:22.070186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:22.070648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:22.071571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:22.072077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:22.073709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fda49-dad9-492f-ba23-80b41e94302b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:22.086547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 429/869] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:22.092821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:22.198484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30086738-c94f-4a3b-b607-46822e82a1e9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:22.232911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:22.233593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:22.233877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:22.234151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:22.234875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:22.235185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:22.236614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689fc01-326e-49e0-a34c-f23a0bc1130f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:22.243159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 441/870] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:22 2022] GET /identity/v3/role_assignments?user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:22.389428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a75b-bd56-4cd1-a231-ff872a07f1a9 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:22.389428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a75b-bd56-4cd1-a231-ff872a07f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:22.389428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959a75b-bd56-4cd1-a231-ff872a07f1a9 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:22.391522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 430/871] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:22.397040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3892-5200-4829-ae64-abdd10b8f6cd None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:22.397330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3892-5200-4829-ae64-abdd10b8f6cd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:22.397643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb3892-5200-4829-ae64-abdd10b8f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:22.417672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6adb3892-5200-4829-ae64-abdd10b8f6cd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:22.418887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6adb3892-5200-4829-ae64-abdd10b8f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:22.465356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:22.486694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 442/872] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:22.755630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959a75b-bd56-4cd1-a231-ff872a07f1a9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:22.860081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959a75b-bd56-4cd1-a231-ff872a07f1a9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:22.896313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:22.896985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:22.897262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:22.897552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:22.898220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:22.899610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451e512-55ce-4a4e-914e-976ac3f73e6a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:22.918144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 431/873] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:22 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:23.124083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d8ef-7136-4ce8-a4a7-59d07456331c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.124637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d8ef-7136-4ce8-a4a7-59d07456331c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.124637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d8ef-7136-4ce8-a4a7-59d07456331c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.126266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 443/874] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:23.131538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0aac-b7c4-409f-b2ad-51574808d973 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.131948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0aac-b7c4-409f-b2ad-51574808d973 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.132093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada0aac-b7c4-409f-b2ad-51574808d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.150868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8ada0aac-b7c4-409f-b2ad-51574808d973 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:23.152052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8ada0aac-b7c4-409f-b2ad-51574808d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:23.154311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:23.231367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 432/875] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:23.259193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f980-1ff7-490b-af95-e48870eb1a69 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.259816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f980-1ff7-490b-af95-e48870eb1a69 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.260287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96f980-1ff7-490b-af95-e48870eb1a69 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.262132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 444/876] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:23.267721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.268009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.268275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.286640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:23.287817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:23.360447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 433/877] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:23.498339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f980-1ff7-490b-af95-e48870eb1a69 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:23.599448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96f980-1ff7-490b-af95-e48870eb1a69 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:23.633254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:23.634072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.634350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.634617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.635198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:23.636654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:23.637165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:23.646423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:23.647455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:23.648337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:23.652918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 445/878] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:23.654221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:23.703153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:23.710592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:23.751372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e021ed-6085-4742-aa44-14c991a6120f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:23.776258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68dea4-9c22-4cfd-85b0-99fc33d341a0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:23.790000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:23.790622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.790896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.791161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.791827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:23.793190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:23.817431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 434/879] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:23 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:23.834974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:23.835636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:23.835976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:23.836246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:23.836927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:23.837230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:23.838704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826ebdf-69c5-4fac-a891-2bd3aeaed215 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:23.844841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 446/880] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:23.851006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:23.970564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad62a3-62ea-41ae-befe-ba4ba09bb5b6 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:23.998119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:24.012407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:24.012948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.013302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.013510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.014147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:24.014438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:24.015805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b466b-0d78-4270-8422-731ab5ba90bf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:24.021519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 435/881] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:24.361720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabe4b-05ef-4c5a-9ceb-8047b3a9e247 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.362235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabe4b-05ef-4c5a-9ceb-8047b3a9e247 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.362235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeabe4b-05ef-4c5a-9ceb-8047b3a9e247 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.363899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 447/882] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:24.369422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e57a5-3f96-4f97-baa0-14ff2bf48ff6 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.369840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e57a5-3f96-4f97-baa0-14ff2bf48ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.370007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e57a5-3f96-4f97-baa0-14ff2bf48ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.390760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-088e57a5-3f96-4f97-baa0-14ff2bf48ff6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:24.392056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-088e57a5-3f96-4f97-baa0-14ff2bf48ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:24.473613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 436/883] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:24.737563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeabe4b-05ef-4c5a-9ceb-8047b3a9e247 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:24.839117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeabe4b-05ef-4c5a-9ceb-8047b3a9e247 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:24.841484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:24.867598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e6bc-fb47-4ad1-a395-9c10270f1939 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.867919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e6bc-fb47-4ad1-a395-9c10270f1939 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.868148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e6bc-fb47-4ad1-a395-9c10270f1939 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.870039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 437/884] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:24.874549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.875085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.875551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.880475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:24.881115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:24.881385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:24.881696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:24.892097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:24.895949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:24.896962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:24.897896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:24.904144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 448/885] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:24.904845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:24.906291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:24.996725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 438/886] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:25.023060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27af60-9f7b-4afc-89db-a1f6698222d1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.057832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.058431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.058702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.058967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.059621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:25.059918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.061276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.071417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 449/887] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:25.077171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.133098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.183642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c753205-24b3-4d2d-a002-a17f7dd7f7f8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.220985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.221657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.221940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.222216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.232548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.234089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:25.248849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:25.249815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:25.250859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:25.250859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:25.250859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:25.250859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 439/888] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:25.257342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.279261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.287346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.370762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1784f5-3478-4271-a6d1-c6cd6aa5c20b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.392850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.396300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bc3e-8a4f-4e00-9950-59289b38c4e5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.408141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.408750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.409023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.409288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.409949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:25.410241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.411739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.428749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 450/889] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:25.430623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.438687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.439652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.440128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.440681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.441610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.443284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:25.452827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:25.453886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:25.454741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:25.457598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 440/890] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:25.463175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.538933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.558242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01e0c8-cffe-4d7c-b1e2-280dc84bd323 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.593000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea341d-5236-48b3-a0e4-4619b3e6ad45 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.601836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.602523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.602800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.603068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.612682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.614488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:25.630519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:25.631510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:25.632464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:25.636735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 451/891] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:25.637866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.638070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.638921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.639420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.639878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.641036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:25.641585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.644247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.655448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 441/892] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:25.656830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.694117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.777759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd47ac-55fd-454e-a730-88f4abadadb0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.788425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad22f75-21e6-4c74-9f42-4d6547ee2b89 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.818010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.819336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.819691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.820065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.820898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:25.821455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.823610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.831186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:25.832074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:25.832783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:25.833241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:25.834198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:25.834678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:25.837341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:25.848030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 442/893] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:25.849127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.851923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 452/894] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:25.859092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:25.863719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.958109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:25.968596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bec59-4cb5-45e8-ba7d-c612b29b7117 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:25.968907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0daef1a-aec9-4072-9ea2-4d525ddd9504 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.003944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.004191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.004546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.004652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.004822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.004921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.005091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.005179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.005840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] RBAC: Adding query filter params (interface=public, service_id=f29109d4fdf8497d841a3b6010d22528, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:26.006142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.007499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a3e42-5248-4a30-b15d-7f13d5a78ff9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.012707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 443/895] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/endpoints?service_id=f29109d4fdf8497d841a3b6010d22528&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:26.013917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112159-7372-4bdb-881e-7cd9d10f033c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.014203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112159-7372-4bdb-881e-7cd9d10f033c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.014473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6112159-7372-4bdb-881e-7cd9d10f033c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.017721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 444/896] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:26.017721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90607-c2e2-4c1b-947e-f403b668a1da None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.017721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90607-c2e2-4c1b-947e-f403b668a1da None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.017721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea90607-c2e2-4c1b-947e-f403b668a1da None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.021437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 445/897] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:26.021437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90607-c2e2-4c1b-947e-f403b668a1da None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.076847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.078237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991318-ddaa-4b49-9293-9f92162fef35 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.080825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.125557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea90607-c2e2-4c1b-947e-f403b668a1da None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.162689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.163317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.163595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.163889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.164489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.165886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795a70a-a9a3-4543-84ff-173e73934e3f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.171435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 446/898] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:08:26.172755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.173032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.173304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.184100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 453/899] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:25 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 27 02:08:26.185217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.185528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.185795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.196784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:26.198466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:26.205707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:26.206932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:26.217536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.283058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 447/900] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:26.284212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.303837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 454/901] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:26.403415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18f31f-f424-4b1f-8b8c-741d88c94e4c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.439294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.439941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.440221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.440493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.451173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.452628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:26.468444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:26.469539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:26.470513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:26.470513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:26.470513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:26.470513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 448/902] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:26.475338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.510989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.558298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.563289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.580989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb7358-a2be-4c04-ab89-15260f3c7bf3 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.619046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.619909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.620181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.620443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.621229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:26.621868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.623235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.635509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 455/903] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:26.636120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.676663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734a7a-ca37-4078-8fe6-a7ce1a6f2c8c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.722831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.723897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.724337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.724755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.725654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.727627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:26.738885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:26.739896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:26.740797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 449/904] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:26.742241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.746486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.755204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ed7b2-db2a-4790-858d-5968e9c8a4a9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.792814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.793431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.793715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.793974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.794620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.796069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.811603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 456/905] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:26 2022] POST /identity/v3/services => generated 241 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:26.812416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.832748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:26.863197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3837be94-f32a-4eb6-a3d6-d3190433eaba None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.912531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.913616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.914085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.914532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.926790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.928571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:26.942189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:26.943351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:26.944453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:26.945625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 450/906] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:26.949589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31e966-71b4-43cb-abb2-6becb494ac05 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:26.951290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:26.989850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:26.990841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:26.991298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:26.991743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:26.992595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:26.993157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:26.994828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.000003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 457/907] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:27.005648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:27.028733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:27.084768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875a8f6-2a79-4d44-919f-844d02762c80 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:27.113922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:27.129258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:27.130528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:27.131211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:27.131643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:27.132788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:27.133587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:27.135644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.139716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3e96a-31f7-4c70-a73b-6bba57bad9bb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:27.156877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 451/908] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:27.158664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:27.187477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:27.188092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:27.188431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:27.188921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:27.189691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:27.189991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:27.192082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.203679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 458/909] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:27.204583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:27.278084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810874aa-9aa6-46db-8005-890ef8a6ed9d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:27.318410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:27.333154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccb802-3862-4f7e-a96b-bec606733c60 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:27.335450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:27.336405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:27.336838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:27.337264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:27.338192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] RBAC: Adding query filter params (role.id=ff04d4ba3aa04ce482363e1589fff680, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:27.338661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:27.340374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.347661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 452/910] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:27 2022] GET /identity/v3/role_assignments?user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=ff04d4ba3aa04ce482363e1589fff680 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:27.372526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:27.373155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:27.373459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:27.373731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:27.374441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] RBAC: Adding query filter params (interface=public, service_id=4285d232ea19497a94f76dd3930a73fa, region_id=RegionOne) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:27.374744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:27.376170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824e9d0-896e-4e6a-842b-75ed52c27657 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.385111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 459/911] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:27 2022] GET /identity/v3/endpoints?service_id=4285d232ea19497a94f76dd3930a73fa&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:27.390974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:27.449763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:27.510805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b0ce64-9a9c-478e-8716-afcfc4ab11f4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:27.546924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:27.547903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:27.548401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:27.548907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:27.549803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:27.551346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d00be7-3e3c-4d3e-af5e-4adc3cf680b6 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:27.558114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 453/912] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:27 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:08:28.278239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7b393-b089-4bab-9a1e-e9c85cb62d2a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.278790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7b393-b089-4bab-9a1e-e9c85cb62d2a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.278790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7b393-b089-4bab-9a1e-e9c85cb62d2a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.280399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 460/913] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:28.285873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f3b8d-ff04-4643-a034-67a3abdad43c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.286169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f3b8d-ff04-4643-a034-67a3abdad43c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.286451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f3b8d-ff04-4643-a034-67a3abdad43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.305175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6c5f3b8d-ff04-4643-a034-67a3abdad43c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:28.308841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6c5f3b8d-ff04-4643-a034-67a3abdad43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:28.381204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 454/914] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:28.646072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7b393-b089-4bab-9a1e-e9c85cb62d2a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:28.755986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7b393-b089-4bab-9a1e-e9c85cb62d2a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:28.790360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:28.791006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.791287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.791562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.792153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:28.793580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:28.802286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b61c1-1351-46d4-8a13-952a0bf9f69d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.802760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b61c1-1351-46d4-8a13-952a0bf9f69d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-1e30d720-c7d9-4a14-b7d5-df65cab5658e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:28.802836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:28.803786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 27 02:08:28.804735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:28.806435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b61c1-1351-46d4-8a13-952a0bf9f69d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.806576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 461/915] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:28.806714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 455/916] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:28.809965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b61c1-1351-46d4-8a13-952a0bf9f69d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:28.810190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.810459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.810741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.827972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:28.829165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:28.832154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:28.871752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:28.905577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 462/917] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:28.932285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b61c1-1351-46d4-8a13-952a0bf9f69d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:28.968603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:28.969217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:28.969525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:28.969800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:28.970491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:28.970792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:28.972218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:28.977771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 456/918] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:28.983526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.103940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcede6-6e5c-4085-802e-836079cd8d31 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.148095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.148838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.149137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.149496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.150540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:29.150861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.152412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.158924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 463/919] 10.222.0.61 () {56 vars in 1114 bytes} [Sat Aug 27 02:08:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:29.164590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.194062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.197924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:29.294101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d56ad-9072-41cb-8129-4a1a2d7d743b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.295163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2693195-baa0-4e6b-99af-f9466c750072 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.297574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:29.338266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.339225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.339513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.339764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.340562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.342050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a85bd-d181-4276-a90a-aacece41c7f9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.344860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.345777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.346067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.346341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.346941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.348311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-92e0fb84-2de7-4ece-96c2-484e8a9f66a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:29.357519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:29.358586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:29.359477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 464/920] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:29.360842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd73-22fa-4634-9396-c82139abd2f0 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.360842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd73-22fa-4634-9396-c82139abd2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.361019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5cd73-22fa-4634-9396-c82139abd2f0 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.366174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 465/921] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:29.367019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5cd73-22fa-4634-9396-c82139abd2f0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.367639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 457/922] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:29.373437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7933d-451f-41cc-9479-576121f6a36a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.373437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7933d-451f-41cc-9479-576121f6a36a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.373437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7933d-451f-41cc-9479-576121f6a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.397782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cfc7933d-451f-41cc-9479-576121f6a36a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:29.400172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cfc7933d-451f-41cc-9479-576121f6a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:29.452226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:29.498949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5cd73-22fa-4634-9396-c82139abd2f0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.523241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 458/923] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:29.544665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.545510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.545937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.546337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.547284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:29.547685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.549796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.553009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c809-3465-4d9f-a85a-d09158757efa None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.553292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c809-3465-4d9f-a85a-d09158757efa None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.553592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056c809-3465-4d9f-a85a-d09158757efa None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.555132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 459/924] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:29.559503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 466/925] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:29.560585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.560843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.561170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.565589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.590200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:29.592822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:29.678989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 460/926] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:29.688722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88957b26-9f99-4c82-9448-8e22156873e7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.716016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:29.724838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.725543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.725826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.726099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.726795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:29.727098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.728475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.734128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 467/927] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:29.739979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.762741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:29.791534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.870614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581f687-bd88-414e-91d7-0481b5822ec8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.911041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9729251-d8d3-48f2-84a3-667a5ab9bdeb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:29.915988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.916778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.917214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.917661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.918517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] RBAC: Adding query filter params (interface=public, service_id=7e45ae1c5f21407385899e79b6e8238e, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:29.918971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:29.921052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:29.938939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 461/928] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/endpoints?service_id=7e45ae1c5f21407385899e79b6e8238e&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:29.940301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:29.976712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:29.977266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:29.977578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:29.977848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:29.988614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:29.993879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:29.994824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:29.995680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 468/929] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:29.998233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.044914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.056204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.066776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d197499-ce78-472e-8c60-a90f29f5441f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.104817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.105453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.105736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.106003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.106614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.107988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.119597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51b70e-1b53-45a9-9eb1-4befd172f51e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.122016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 462/930] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:08:30.124352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.161662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.162314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.162591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.163008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.163514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.165122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:30.175086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:30.176116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:30.177016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 469/931] 10.222.0.61 () {56 vars in 1132 bytes} [Sat Aug 27 02:08:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:30.182802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.259657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb09b7-740a-4748-b874-76651c5597aa None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.311262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.311891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.312175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.315795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.316528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:30.316837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.318267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.321475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b162-dc6a-43d3-8dfa-e52a6ece3e85 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.331725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 463/932] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:30.333010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.345441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.349601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.365624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.366237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.366514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.366811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.367614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:30.367950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.369573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.379753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 470/933] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:30.380676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.443150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e59a8e-ed17-4725-b7f8-0ef0141386d9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.478604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.479496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.479951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.480367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.491072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbd403-e3a2-462e-8c5e-761f43ac4dea None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.491995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.493657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:30.508832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:30.510189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:30.511318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:30.511318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:30.511318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:30.517564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 464/934] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:30.519477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.534605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.535743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.536178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.536586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.537520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:30.538365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.540526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.547222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 471/935] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:30.553130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.591941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.614830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.648186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a2f00-f9bd-4da2-a93f-29fea90a818d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.682709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298f2dc-205a-4f87-bbe1-b9f7c4e0221c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.687890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.688824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.689253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.689715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.690603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:30.691138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.692809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.711003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 465/936] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:30.712748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:30.718473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.719084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.719428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.719697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.720384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.721853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.757425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 472/937] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:30.837936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9855c9a-0e17-4398-b174-f9292f56719b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:30.864950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:30.885051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:30.885749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:30.886000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:30.886275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:30.894641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:30.895950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:30.908851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:30.909867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:30.911098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 466/938] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:30.918182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.021592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:31.026993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be12354-8c02-4140-8862-568592fa02e0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.065276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.065925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.066202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.066470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.067209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:31.067513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.068952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:31.087755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 473/939] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:31.093655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.207597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dcad-9059-4892-97f6-dacd4b45b996 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.244749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.245424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.245732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.246008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.258995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.260502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:31.278161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:31.279166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:31.280059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:31.280059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:31.280059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:31.282455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 467/940] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:31.288650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.403469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff048ec-7657-46ed-a490-f44d98a00c29 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.439810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.440472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.441032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.441305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.441995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:31.442292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.443661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:31.455947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 474/941] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:31.461821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.494697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:31.576284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4ed473-3f5b-4477-b26c-f6e675abb641 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.611363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.611998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.612278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.612549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.620157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.621645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:31.634993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:31.635952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:31.637061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 468/942] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:31.644086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.665875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:31.757617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4a46f-a484-44df-8e3f-2f16b25daed0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.793368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.794015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.794294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.794572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.795289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:31.795604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.797048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44090bd-63c7-47d4-a85b-bf3e1c59bbd2 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:31.810456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 475/943] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:31.818507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:31.855501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69615-5d3f-4c6b-9b70-c0692f8db5d1 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.855920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69615-5d3f-4c6b-9b70-c0692f8db5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.856322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa69615-5d3f-4c6b-9b70-c0692f8db5d1 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.858782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 476/944] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:31.866501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8feea-8c62-4880-9345-8f8315947c6c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.866955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8feea-8c62-4880-9345-8f8315947c6c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.867360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8feea-8c62-4880-9345-8f8315947c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.892652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a1a8feea-8c62-4880-9345-8f8315947c6c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:31.894428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1a8feea-8c62-4880-9345-8f8315947c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:31.926790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:31.937891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70492d-be2d-4445-bc70-79150c6d1873 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:31.993440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:31.993440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:31.993440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:31.993440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/95fe53e9d4d34a4e9c2d3dcee43c1f65/roles/ff04d4ba3aa04ce482363e1589fff680` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:31.993884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=95fe53e9d4d34a4e9c2d3dcee43c1f65, role_id=ff04d4ba3aa04ce482363e1589fff680)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:31.993884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12989f-991e-46b9-a65b-753fb5be05ab None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.009543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 469/945] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:31 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/95fe53e9d4d34a4e9c2d3dcee43c1f65/roles/ff04d4ba3aa04ce482363e1589fff680 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:08:32.024727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 477/946] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:32.110717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64146-7248-4a39-917e-386f1e588fd8 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.111119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64146-7248-4a39-917e-386f1e588fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.111289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a64146-7248-4a39-917e-386f1e588fd8 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.112815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 470/947] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:32.119057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.119680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.120151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.142622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:32.144198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:32.146718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:32.216630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 478/948] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:32.333463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a64146-7248-4a39-917e-386f1e588fd8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.454045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a64146-7248-4a39-917e-386f1e588fd8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:32.491861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:32.492389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.492668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.492939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.493621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:32.495073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.497936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.498573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING keystone.server.flask.common [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 02:08:32.519579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.sql.core [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 02:08:32.519579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 02:08:32.519579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [parameters: {'id': '8d7c9c33e103451cb0ac3162b8222d54', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 02:08:32.519579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81747) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d7c9c33e103451cb0ac3162b8222d54.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d7c9c33e103451cb0ac3162b8222d54. Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:08:32.546402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application result.read() Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 27 02:08:32.547803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application yield resource Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise self.value Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application session.commit() Aug 27 02:08:32.549492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self.session.flush() Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application compat.raise_( Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:08:32.551042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 02:08:32.552585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application result.read() Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:08:32.553974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [parameters: {'id': '8d7c9c33e103451cb0ac3162b8222d54', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.555482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:32.559434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8d7c9c33e103451cb0ac3162b8222d54. Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 471/949] 10.222.0.61 () {60 vars in 1140 bytes} [Sat Aug 27 02:08:32 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:32.562905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.594542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:32.637890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420ec0e-eee7-432b-ba42-38db7fd63e37 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:32.684652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:32.685289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.685597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.685873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.686465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:32.687196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d8fcc-2dac-4df2-ad1b-a8a82129534c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:32.687869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:32.697876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:32.701223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:32.703139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 479/950] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:32.713895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.716891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:32.728027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:32.728751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.729100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.729752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.737376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:32.739237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:32.751347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:32.752241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:32.753133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:32.757590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 472/951] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:32.758870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.828328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:32.831838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c58cb-2c39-41ae-b05d-bfdee1228aa1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:32.866832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9485b8-8bb1-4c53-b386-711fa8f4d222 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:32.869588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:32.870448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.870928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.871438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.872274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:32.872787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:32.874463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.880577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 480/952] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:32.889935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:32.904705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:32.905322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:32.905629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:32.905901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:32.906579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:32.906932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:32.908370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07933900-6eff-4762-a57b-0bc2065dc2da None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:32.937548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 473/953] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:33.018032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:33.020923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4c13-6317-43ba-84c8-caf7439be35f None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.021239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4c13-6317-43ba-84c8-caf7439be35f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.021547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4c13-6317-43ba-84c8-caf7439be35f None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.023241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 474/954] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:33.031031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.031468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.031842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.059780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:33.062920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:33.067283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35509e39-5011-49ec-ad62-c4e251267b6f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:33.115741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:33.116382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.116658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.116925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.117582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:33.118061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:33.119478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:33.126657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 481/955] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:33.133747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:33.174228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 475/956] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:33.247599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25042a72-73a0-4561-86fd-579d4fae973c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:33.277860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:33.284275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:33.284881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.285158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.285455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.286124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:33.287492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:33.313467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 482/957] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:33.544466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:33.635953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:33.706256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb719ba-bd8a-408d-90e5-3245df3fd2a4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:33.772839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:33.773954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.774420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.775169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.776165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:33.778678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:33.795094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:33.796230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:33.797131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:33.798042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 476/958] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:33.806645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:33.913863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96096fde-11a1-438c-8b68-89aed5db27be None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:33.948446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:33.949052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:33.949328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:33.949627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:33.950253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:33.950550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:33.951949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b856b-3b0e-462f-bf63-361ffb305545 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:33.957420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 483/959] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:33.966283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:34.077605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c7f5-14b0-4a32-8b51-809b41d39823 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:34.102418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:34.124001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:34.124999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:34.125498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:34.125959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:34.127063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:34.127581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:34.130105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdaa0b-ed21-4a49-9dfd-add36dbb82ff None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:34.138410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 477/960] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:34.340709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae3e7f-2cd4-4c90-96cb-6c6f5c1b3474 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:34.341019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae3e7f-2cd4-4c90-96cb-6c6f5c1b3474 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:34.341370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae3e7f-2cd4-4c90-96cb-6c6f5c1b3474 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:34.343057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 484/961] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:34.348662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:34.348953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:34.349233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:34.367991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:34.369416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:34.463208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 478/962] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:34.734145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae3e7f-2cd4-4c90-96cb-6c6f5c1b3474 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:34.787585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:34.844696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae3e7f-2cd4-4c90-96cb-6c6f5c1b3474 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:34.903654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:34.904695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:34.905174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:34.905681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:34.923408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-4cb89710-3d4d-455e-80b0-95beced5bd26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:34.932751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:34.935090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:34.936974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 485/963] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:34.942503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.086299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f54ec-43ad-4f75-8ff6-43d0ccb0cf3b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.086566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f54ec-43ad-4f75-8ff6-43d0ccb0cf3b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.086960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f54ec-43ad-4f75-8ff6-43d0ccb0cf3b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.088616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 486/964] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:35.093750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4b6a-0459-48c6-b2b8-309383c3e1c5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.094041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4b6a-0459-48c6-b2b8-309383c3e1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.094457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd4b6a-0459-48c6-b2b8-309383c3e1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.111365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20152a0-aaea-465b-bc40-b94a72de6cc3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.112624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-dffd4b6a-0459-48c6-b2b8-309383c3e1c5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:35.114110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-dffd4b6a-0459-48c6-b2b8-309383c3e1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:35.127544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:35.166384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:35.167371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.167838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.168293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.169484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:35.170008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:35.172500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:35.193489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 479/965] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:35.196623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.198467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 487/966] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:35.355303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9854e8-2580-4d60-8f22-e6e842cf4544 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.355757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9854e8-2580-4d60-8f22-e6e842cf4544 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.355757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9854e8-2580-4d60-8f22-e6e842cf4544 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.358585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6a343-ec9a-46a8-8ddc-0809f5771cf5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.361424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 488/967] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:35.362965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.363224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.363508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.381691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:35.382965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:35.394651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:35.395291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.395562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.395827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.408459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:35.410461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:35.419166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:35.430300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:35.432374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:35.434504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:35.434504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:35.434504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:35.434504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 480/968] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:35.440722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.465551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 489/969] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:35.485541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:35.554394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.624453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380724a-94c7-4fa1-b5d5-16f7f3bb5f8f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.660240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:35.660871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.661182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.661554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.662204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:35.662533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:35.664129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:35.677764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 481/970] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:35.686392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.725363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edca3b-0c7e-4e4a-9795-4b85cd7a6179 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.780783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:35.781413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.781934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.782111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.782756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:35.784183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:35.786769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING keystone.server.flask.common [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 27 02:08:35.791161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:35.800569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.sql.core [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 02:08:35.800569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 02:08:35.800569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [parameters: {'user_id': '4b4c5c4285b74d4cbdfd155af453f1d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 02:08:35.800569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81748) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result.read() Aug 27 02:08:35.813645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:08:35.814579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application yield resource Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application next(self.gen) Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.session.rollback() Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.force_reraise() Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise self.value Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application session.commit() Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 27 02:08:35.815675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._prepare_impl() Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.session.flush() Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._flush(objects) Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application compat.raise_( Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application flush_context.execute() Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rec.execute(self) Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 27 02:08:35.816575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 27 02:08:35.817519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result = self._query(query) Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application conn.query(q) Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application result.read() Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 27 02:08:35.818393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [parameters: {'user_id': '4b4c5c4285b74d4cbdfd155af453f1d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:35.821135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 27 02:08:35.823503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 490/971] 10.222.0.61 () {60 vars in 1131 bytes} [Sat Aug 27 02:08:35 2022] POST /identity/v3/users => generated 160 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:35.827367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.828424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b5f00-1a2e-4a75-a417-2e4feffc2f47 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.861050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:35.861702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:35.861982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:35.862252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:35.869458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:35.870265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:35.871708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:35.884882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:35.885887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:35.886888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 482/972] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:08:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:35.888124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:35.986338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c50e2f-f56b-4fe5-b399-8924bb0af162 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:35.992866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d58ad-b538-4481-8a6e-5850473ea8e5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.041050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.041967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.042301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.042514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.047476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.048599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.049140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.049714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.050589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.050842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.052045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.053912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:36.064200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:36.065529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 27 02:08:36.066699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:36.069746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 483/973] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:36.070737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:36.072856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:36.073979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:36.075029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:36.075845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.084016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 491/974] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:36.084016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.199053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81711d11-b6da-4e09-b9fb-bd3672e7eb2a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.206313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.213251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73282f-f412-42c1-8354-a727bb9238ee None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.256817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.257842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.258257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.258445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.258721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.258987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.259198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.259680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:36.259887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.259991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.261404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.261513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:36.262113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.264634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.301008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 484/975] 10.222.0.61 () {56 vars in 1149 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:36.301008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.306235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 492/976] 10.222.0.61 () {56 vars in 1101 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:36.307756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.432549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.459115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039258e3-9440-4f5b-92de-c82ba8ca4743 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.500535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3ab2-95ce-437a-a7cd-2d7a9de1fe95 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.520201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.520829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.521109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.521378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.549376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.552651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.553230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.553844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.556600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:36.557259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.559989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.562540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.569488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 485/977] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:36.579227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.622057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.624626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.688351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026ecca-ab2b-4eda-b068-ee4452ad634b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.714273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.723348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.723946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.724392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.724670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.725715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:36.726044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.727572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.732919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 486/978] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:36.739304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.748952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 493/979] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:36.754668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.820364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:36.863998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25116edb-cc7c-4717-a46f-41dabf52d1e6 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.877598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a916d92-87cf-42df-b8f3-7e914d77a1c5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:36.910357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.911302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.911555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.911889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.912454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] RBAC: Adding query filter params (interface=admin, service_id=7e45ae1c5f21407385899e79b6e8238e, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:36.912762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.914397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.914998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:36.915617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:36.915900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:36.916170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:36.920979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 487/980] 10.222.0.61 () {56 vars in 1249 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/endpoints?service_id=7e45ae1c5f21407385899e79b6e8238e&interface=admin®ion_id=RegionOne => generated 193 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:36.926755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:36.931022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:36.933581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:36.957432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:36.958449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:36.964843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:36.964843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:36.964843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:36.964843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 494/981] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:36.965285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:37.012451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:37.066619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58b6b-140a-48de-ae61-af733ab68e70 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.098146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d898-d889-4c5b-9952-b1284ffa7637 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.106519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:37.115214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.115918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.116247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.116664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.117372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.118926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80398e-6128-4933-95df-f5bc18402f8b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.126818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 488/982] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:08:37.128162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549769-6e9b-407a-98cf-b25ca3a6bcd8 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.128643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549769-6e9b-407a-98cf-b25ca3a6bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.129116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81549769-6e9b-407a-98cf-b25ca3a6bcd8 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.131174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 489/983] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:37.137210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.137619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.137892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.149546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.150472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.150749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.151018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.151672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:37.151977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.153374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.162583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:37.164471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:37.168057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 495/984] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:37.175738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:37.253070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 490/985] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:37.327687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973dad4-4f4f-4381-9fd2-be8eff7c1e1b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.373022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.373676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.373945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.374212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.382278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.383740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:37.395872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:37.397640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:37.398952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 496/986] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:37.405215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:37.486806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:37.569295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:37.572385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0a8ce-8d0b-429a-aad5-ea242d247e7c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.612211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:37.614975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.615621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.615977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.616291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.617038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:37.617343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.618818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.636966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 491/987] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:37.638125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:37.732955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25500b-4a3b-403d-834d-898bcf87436a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.749341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a58fd-3cb2-4fd4-bef4-bcba365e46a1 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:37.759726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:37.788101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.789172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.789689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.790144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.791305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.793132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:37.793766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc960f-2132-40f1-aaee-248343423300 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.794274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:37.794813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:37.795350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:37.796611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] RBAC: Adding query filter params (role.id=ff04d4ba3aa04ce482363e1589fff680, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:37.797218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:37.799642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb7f6e-ab34-4d4e-bea9-6126150d9ee7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:37.821873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 492/988] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:37 2022] GET /identity/v3/role_assignments?user.id=95fe53e9d4d34a4e9c2d3dcee43c1f65&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=ff04d4ba3aa04ce482363e1589fff680 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:37.824851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 497/989] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:37 2022] POST /identity/v3/services => generated 242 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:39.462681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12b9e-a68e-40db-8179-59607018aa5c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:39.463233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12b9e-a68e-40db-8179-59607018aa5c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:39.463613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12b9e-a68e-40db-8179-59607018aa5c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:39.466052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 493/990] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:39.474962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b40ab8-4355-4209-9bc7-6f20bb867083 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:39.475454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b40ab8-4355-4209-9bc7-6f20bb867083 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:39.476086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b40ab8-4355-4209-9bc7-6f20bb867083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:39.505948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-43b40ab8-4355-4209-9bc7-6f20bb867083 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:39.508580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-43b40ab8-4355-4209-9bc7-6f20bb867083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:39.634835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 498/991] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:39.975724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42fe7f-ae0b-464b-803b-22006c34267f None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:39.976135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42fe7f-ae0b-464b-803b-22006c34267f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:39.976509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42fe7f-ae0b-464b-803b-22006c34267f None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:39.978705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 494/992] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:39.986453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:39.986939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:39.987384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.015780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:40.017762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:40.031475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1346-704a-4c45-a448-84ff58928530 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.031718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.031871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1346-704a-4c45-a448-84ff58928530 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.032021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1346-704a-4c45-a448-84ff58928530 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.034474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 495/993] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:40.043693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.044128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.044511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.071708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:40.073621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:40.113311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 499/994] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:40.114202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.165644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 496/995] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:40.251016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596c3d1-5b7b-46bb-97b3-1c6a2156acfc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.288784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.289836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.290344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.290814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.291855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.293680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:40.303007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:40.305905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.306783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 500/996] 10.222.0.61 () {56 vars in 1126 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:40.318400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.406063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.416195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.467206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5db38-2a1f-4f42-ba14-cec1e03fb328 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.469874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.510017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20045049-3c12-4662-833f-e78464028135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.510522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045049-3c12-4662-833f-e78464028135 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.510799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045049-3c12-4662-833f-e78464028135 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.511068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20045049-3c12-4662-833f-e78464028135 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.511706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20045049-3c12-4662-833f-e78464028135 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:40.512006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20045049-3c12-4662-833f-e78464028135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.513373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20045049-3c12-4662-833f-e78464028135 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.518781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 497/997] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:40.519567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20045049-3c12-4662-833f-e78464028135 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.527780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cfd95-eb4c-44b7-a454-5ba23fcb37fc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.570781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.571419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.571696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.571963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.572604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.574476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:40.583483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:40.585133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:40.586804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 501/998] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:40.588472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.634814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20045049-3c12-4662-833f-e78464028135 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.670624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.673829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.674472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.674738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.675008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] PATH_INFO: `/v3/services/image` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.675590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.676951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:40.686329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:40.688118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:40.690045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 498/999] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:40.691672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.712194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a685a-9466-4845-b60f-d042514407ff None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.720361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.752207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.752821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.753093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.753356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.754124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:40.754420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.755781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.760909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 502/1000] 10.222.0.61 () {56 vars in 1122 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:40.761629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.805614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ecf37-a6e5-4f3b-be54-07c881174a76 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.842362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.842969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.843248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.843519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.844156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:40.844469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.845865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.850779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 499/1001] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:40.851631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.875533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b25e1-df6f-4817-b800-1dabb5b61818 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:40.915887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:40.916494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:40.916769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:40.917039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:40.917701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] RBAC: Adding query filter params (name=image) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:40.918000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:40.919372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:40.920568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.925896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 503/1002] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:40.926564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:40.976339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:40.984892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194995e5-3323-4dd4-896d-f80b68754cb3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:41.021146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:41.021687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:41.021964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:41.022217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:41.022978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:41.024342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:41.044155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28599143-389e-4e59-9b26-d9a1c602fc24 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:41.044995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 500/1003] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:41.045873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:41.094458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:41.094982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:41.095263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:41.095532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:41.096183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:41.096494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:41.097951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:41.105436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 504/1004] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:41.111351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:41.189000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:41.217297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093cbd7-8d7e-4028-a731-bdd233cc24a3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:41.237380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1bd18-d851-4ba8-9ee7-1f24b1727ba0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:41.269260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:41.270029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:41.270504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:41.270863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:41.271868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] RBAC: Adding query filter params (type=image) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:41.272493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:41.274590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:41.278995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:41.279618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:41.279888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:41.280153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:41.280859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] RBAC: Adding query filter params (interface=public, service_id=9143bd69f8ef46cbb9a4d76bed2a1c69, region_id=RegionOne) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:41.281162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:41.285452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 501/1005] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:41.285655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38509c-6c71-453c-b196-0dc074ff1e04 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:41.291284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 505/1006] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:41 2022] GET /identity/v3/endpoints?service_id=9143bd69f8ef46cbb9a4d76bed2a1c69&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:41.299233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:41.324411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:41.419444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56702ba-8618-4b8d-a549-60eb092320bc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:41.457417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:41.458037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:41.458318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:41.458590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:41.459265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:41.460780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2f618-a7c7-4964-8632-7343eca390e7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:41.467548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 502/1007] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:41 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:08:43.008223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7e89-7912-4f86-a08e-b7c565da8f33 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.008807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7e89-7912-4f86-a08e-b7c565da8f33 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.008807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7e89-7912-4f86-a08e-b7c565da8f33 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.010294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 506/1008] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:43.015684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46931e6-0bae-4dbe-9e07-e9f275d582e0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.016273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46931e6-0bae-4dbe-9e07-e9f275d582e0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.016273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46931e6-0bae-4dbe-9e07-e9f275d582e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.035607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f46931e6-0bae-4dbe-9e07-e9f275d582e0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:43.036792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f46931e6-0bae-4dbe-9e07-e9f275d582e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:43.108518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 503/1009] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:43.371899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7e89-7912-4f86-a08e-b7c565da8f33 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:43.434980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068512f2-85b4-4d99-8620-10576f7a9f7d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.435341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068512f2-85b4-4d99-8620-10576f7a9f7d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.435510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068512f2-85b4-4d99-8620-10576f7a9f7d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.436870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 504/1010] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:43.442127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f7e21-5460-4f2d-9772-ac7c6b00b59d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.442526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f7e21-5460-4f2d-9772-ac7c6b00b59d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.442951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f7e21-5460-4f2d-9772-ac7c6b00b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.461010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f31f7e21-5460-4f2d-9772-ac7c6b00b59d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:43.462332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f31f7e21-5460-4f2d-9772-ac7c6b00b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:43.471036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:43.482132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7e89-7912-4f86-a08e-b7c565da8f33 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:43.508359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:43.522289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:43.522967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.523246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.523518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.525376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:43.526847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:43.528437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 507/1011] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:43.534630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:43.538582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 505/1012] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:43.642551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e575468-0506-41e9-8665-7edff35fb8c0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:43.678579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:43.679260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.679532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.679799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.680440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:43.681927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:43.695077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde328-5fe8-4c01-9f04-abc83ecb328a None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.695501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde328-5fe8-4c01-9f04-abc83ecb328a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.695928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cde328-5fe8-4c01-9f04-abc83ecb328a None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.698279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 506/1013] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:43.707413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.707827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.708231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.713510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 508/1014] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:43 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:43.733885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:43.735142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:43.807197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:43.815470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 507/1015] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:43.855462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:43.926097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9cb82-0d20-4ce0-8b65-0f3cc45fe272 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:43.978137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:43.979047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:43.979471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:43.979869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] PATH_INFO: `/v3/services/compute` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:43.980742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:43.982940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:43.997148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:43.998780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:44.000122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 509/1016] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:44.005132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:44.084717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:44.105820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:44.140804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700385f-d714-48e2-bcf4-5102be67954c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:44.179536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:44.180211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:44.180494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:44.180765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:44.181419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:44.181721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:44.183108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:44.193448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 508/1017] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:44.197237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:44.207303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a6876-657f-49fb-96fb-b6c7f57137ae None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:44.215591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:44.245894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:44.246504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:44.246777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:44.247047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:44.247703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:44.249075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:44.272489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 510/1018] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:08:44 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:08:44.348628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0bcdc-6d1e-4d67-8b30-f6116254b94b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:44.394995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:44.403325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:44.404139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:44.404559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:44.404971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:44.405890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:44.406333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:44.408869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dff88-7286-4813-a371-cc2f9c1dd00d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:44.418170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 509/1019] 10.222.0.61 () {56 vars in 1112 bytes} [Sat Aug 27 02:08:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:44.426688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:44.544649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0467-d121-4988-a094-6c3fae7afb41 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:44.582233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:44.583029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:44.583446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:44.583846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:44.584638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:44.586257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97b8c8-aafb-4b40-9e75-95fc97877077 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:44.608796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 511/1020] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:44 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:45.714761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4762d2-53a3-4b11-b03d-ae04ee3a4304 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:45.715347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4762d2-53a3-4b11-b03d-ae04ee3a4304 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:45.715347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4762d2-53a3-4b11-b03d-ae04ee3a4304 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:45.716814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 510/1021] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:45.722292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:45.722796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:45.722796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:45.742019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:45.743220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:45.766114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:45.826154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 512/1022] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:46.087427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4762d2-53a3-4b11-b03d-ae04ee3a4304 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:46.193222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4762d2-53a3-4b11-b03d-ae04ee3a4304 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:46.229408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836f522-935f-46f3-a011-99480129a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:46.230065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836f522-935f-46f3-a011-99480129a933 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.230342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836f522-935f-46f3-a011-99480129a933 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.230586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836f522-935f-46f3-a011-99480129a933 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.231766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836f522-935f-46f3-a011-99480129a933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:46.233191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d836f522-935f-46f3-a011-99480129a933 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:46.239771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 511/1023] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:46.241149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:46.350960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e22be-70d0-4df1-86d0-c53e5326b43c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:46.396844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:46.397656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.397955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.398220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.398893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:46.401181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c29d6-7f63-4f89-81d7-757b941f2335 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:46.436664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 513/1024] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:08:46 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:46.523392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408087af-e386-4bd0-8507-a2c4f1b346d5 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.523740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408087af-e386-4bd0-8507-a2c4f1b346d5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.523930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408087af-e386-4bd0-8507-a2c4f1b346d5 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.525812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 512/1025] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:46.531307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855de3-d696-48b5-ba07-b1baf78b4134 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.531585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855de3-d696-48b5-ba07-b1baf78b4134 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.531857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2855de3-d696-48b5-ba07-b1baf78b4134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.539220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:46.554311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b2855de3-d696-48b5-ba07-b1baf78b4134 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:46.555508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b2855de3-d696-48b5-ba07-b1baf78b4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:46.632627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 514/1026] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:46.663748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825775-991c-47ef-825f-d92b9d6c1e5a None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.664030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825775-991c-47ef-825f-d92b9d6c1e5a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.664305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae825775-991c-47ef-825f-d92b9d6c1e5a None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.665840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 513/1027] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:46.671518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:46.671906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:46.672211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:46.692640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:46.693936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:46.767262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 515/1028] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:46.892345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825775-991c-47ef-825f-d92b9d6c1e5a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:46.961696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.001512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae825775-991c-47ef-825f-d92b9d6c1e5a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.036733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.037361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.037667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.037945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] PATH_INFO: `/v3/services/image` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.038558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.039939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.048254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:47.048850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:47.049862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:47.050703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 514/1029] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Aug 27 02:08:46 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:47.055660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.114767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.155975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9b8cf-2294-456a-89f6-cc07f2991206 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.169032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37829b4a-550e-4579-8553-e61d61e2fe23 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.190860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.191484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.191763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.192033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.198936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.203690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:47.208080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:47.208592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:47.209787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:47.210672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:47.211306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.211306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.211306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.211494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 516/1030] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:47.213781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:47.214093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.215469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.216764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.226146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 515/1031] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:47.227153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.328122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecc714-4d1f-48c5-8bf3-5f533d19bc0b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.337054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61205dba-4867-4081-9f89-dfcf8f599d47 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.353898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.366436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.367331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.367886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.368342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.369360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:47.369494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.371269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.374447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.375052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.375326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.375591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.376223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] RBAC: Adding query filter params (type=image) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:47.376519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.377901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.381329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 517/1032] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:47.383375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 516/1033] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:47.389240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.389364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.451810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.496830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efbd7f-d755-4bb3-ad81-e45e164206ea None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.497064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b59828-5dde-4a2b-8472-88b87aada513 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.533170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.533980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.534210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.534503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.535189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] RBAC: Adding query filter params (interface=public, service_id=6214bb92ae0d48afa5059b20c8976fe0, region_id=RegionOne) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:47.535521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.536900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.537821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.538668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.539080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.539484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.542159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 517/1034] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/endpoints?service_id=6214bb92ae0d48afa5059b20c8976fe0&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:47.547808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.552761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.554543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:47.570263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:47.571483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:47.572567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:47.572567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:47.572567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:47.574524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 518/1035] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:47.580866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.625083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.657945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387f71aa-7a49-45d0-a356-48086905c3da None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.678757 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:47.688640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2b171-25f9-41b6-a2d6-efd6a9f94d76 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.693764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.694391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.694697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.694999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.695574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.696934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.703922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 518/1036] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:08:47.727479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.728107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.728381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.728648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.729308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:47.729637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.731162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.750339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 519/1037] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:47.752212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:47.862100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7eb5c1-6002-49e3-bc42-bb8da2ca7d86 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:47.900146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:47.900786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:47.901439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:47.901439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:47.909515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:47.910965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:47.922423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:47.923393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:47.924351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:47.928378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 519/1038] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:47.929802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.030468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:48.034829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414638e-e06c-4c4c-9dfa-8cfe09d92673 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.070661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.071270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.071553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.071822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.072552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:48.072848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:48.074345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa86893-a280-499c-929e-10721adc0802 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:48.092597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 520/1039] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:48.099929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.147343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:48.219211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66c6df-7359-4df6-b6bc-6eb38dacd259 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.271109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.271716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.271989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.272255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.344282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:48.346130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:48.392797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:48.410731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7f1e-49fa-4d05-8273-c43581c31fac None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.411015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7f1e-49fa-4d05-8273-c43581c31fac None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.411296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e7f1e-49fa-4d05-8273-c43581c31fac None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.412775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 521/1040] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:48.417720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.417999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.418256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.436788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:48.438111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:48.462084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 520/1041] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:48.468274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.518217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 522/1042] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:48.580665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a748d-7f97-4723-b86f-75aac0075a15 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.617807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.618804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.619315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.619801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.631824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:48.633821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:48.637895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:48.653424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:48.654588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:48.655628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:48.655628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:48.655628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:48.657533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 521/1043] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:48.661895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.751173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:48.767114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683fb36-03ed-4931-a26c-7bb8c5ed9ef7 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.787231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.804404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.805026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.805290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.805591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.806245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:48.806543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:48.807915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:48.820418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 523/1044] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:48.826666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.905634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed14f-3af8-4b9c-be04-929cc5351e1f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.944300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.945065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.945408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.945741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.946883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4524d0-145c-40b4-847c-1bbe12c9dbb6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:48.956388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:48.962110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:48.963059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:48.963920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 522/1045] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:48.969187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:48.985006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:48.985671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:48.985947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:48.986214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:48.993213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:48.994497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:49.005523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:49.006394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:49.007438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 524/1046] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:49.013137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.022107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.034990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.083267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e736a3-ed74-49ab-bd30-cd0cb9f369fb None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.119450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f094f-a1a3-4510-bb5e-bfadf6faa983 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.119964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.120930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.121436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.122644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.123510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:49.124022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.125654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.137698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 523/1047] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:49.143393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.155711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.156267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.156545 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.156831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.157552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:49.157954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.159348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.173176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 525/1048] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:49.179185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.250372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.250974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07ec0f-0a7a-4c69-8632-45cef6af73d7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.271213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.286523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426713c-0d07-4277-8bcb-4b16c169c90d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.291545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.292193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.292472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.292737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] PATH_INFO: `/v3/users/305e8f67376d4a59bf38b118e08de53e` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.309411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] RBAC: Authorizing `identity:get_user(user_id=305e8f67376d4a59bf38b118e08de53e)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.311115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.312529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 524/1049] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/users/305e8f67376d4a59bf38b118e08de53e => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:49.321055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.324092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.324691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.324968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.325246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.326369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] RBAC: Adding query filter params (role.id=ff04d4ba3aa04ce482363e1589fff680, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:49.326759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.328279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149737f4-42ad-42a6-8cda-df82e051a8d9 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.336159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 526/1050] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=ff04d4ba3aa04ce482363e1589fff680 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:49.445680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb687b1-ccb9-464c-9629-fad65494235e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.484410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.485020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.485298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.485598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.534756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.558373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.559833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.662324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abe3c-768e-465d-9992-cf7e66040635 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.662653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abe3c-768e-465d-9992-cf7e66040635 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.662846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833abe3c-768e-465d-9992-cf7e66040635 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.663777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 525/1051] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:49.664508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 527/1052] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:49.669670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29167332-2b41-48de-900a-525b5504023e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.669957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29167332-2b41-48de-900a-525b5504023e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.670229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29167332-2b41-48de-900a-525b5504023e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.670329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.687729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-29167332-2b41-48de-900a-525b5504023e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:49.688912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-29167332-2b41-48de-900a-525b5504023e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:49.751078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.757819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 528/1053] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:49.779291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddff790-0dd2-4ac9-8cfb-19b3ded478e3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.814394 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.815019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.815292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.815615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.816741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.818189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.820032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 526/1054] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:49.826182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29167332-2b41-48de-900a-525b5504023e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:49.887294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:49.931614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29167332-2b41-48de-900a-525b5504023e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:49.967325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:49.967984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:49.968229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:49.968507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:49.969260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=c7967de8afca40509e282d92f963da85, user.id=305e8f67376d4a59bf38b118e08de53e) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:49.969595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:49.971027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:49.985426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 529/1055] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:49 2022] GET /identity/v3/role_assignments?user.id=305e8f67376d4a59bf38b118e08de53e&scope.project.id=c7967de8afca40509e282d92f963da85&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:50.026285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:50.139013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d71ded-07fb-44b4-b91c-1a1f31517cc4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:50.174640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:50.175266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:50.175544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:50.175811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] PATH_INFO: `/v3/services/image` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:50.176404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:50.177795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:50.186685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:50.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:50.189100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 527/1056] 10.222.0.61 () {56 vars in 1105 bytes} [Sat Aug 27 02:08:50 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:50.193922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:50.298317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e0ec-fe8e-484e-becb-1fdbe38c630b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:50.326740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:50.339842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:50.340460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:50.340740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:50.341010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:50.341699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] RBAC: Adding query filter params (name=image) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:50.342008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:50.343376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:50.348529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 530/1057] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:50.354286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:50.365974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:50.467357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4753980-ee67-4797-9263-8305fa517a0c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:50.504159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:50.504761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:50.505036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:50.505306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:50.505966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:50.506263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:50.507730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0fcc5-3901-4b31-8475-ea87ccfebf03 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:50.513039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 528/1058] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:50.518953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:50.623198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380321f1-cabf-4887-9019-4df9966d2a34 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:50.658369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:50.658969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:50.659240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:50.659508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:50.660177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:50.661557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d433fa-b455-4087-b09e-5f664ad2e4b5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:50.689622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 531/1059] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:08:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:08:51.191845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef955e-4e3c-4c21-b0d0-5795c0b2381a None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.192409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef955e-4e3c-4c21-b0d0-5795c0b2381a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.192409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef955e-4e3c-4c21-b0d0-5795c0b2381a None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.193710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 529/1060] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:51.199131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.199569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.199657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.218000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:51.219177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:51.264332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:51.313783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 532/1061] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:51.578897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef955e-4e3c-4c21-b0d0-5795c0b2381a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:51.661275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:51.695790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef955e-4e3c-4c21-b0d0-5795c0b2381a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:51.730335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:51.730963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.731243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.731508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.742222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:51.746932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:51.747876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:51.750280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 530/1062] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:51.754199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:51.857525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba3ed4e-5801-497e-9126-cd476dd003b1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:51.892666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:51.893273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.893574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.893837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.894499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:51.894797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:51.896158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cc4277-4ca5-41c6-a1f8-f13f5d15834a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:51.904665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 533/1063] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:51.910278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:51.917468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a456d-d14f-49e6-8d2f-f9686177cf72 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.917761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a456d-d14f-49e6-8d2f-f9686177cf72 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.918035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a456d-d14f-49e6-8d2f-f9686177cf72 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.919478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 534/1064] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:08:51.924155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:51.924430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:51.924724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:51.942411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:51.943599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:51.972814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.016382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 535/1065] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:08:52.025065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb9e31-b7cd-4b4f-a0a3-54fb2d04d0d4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.059313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.064999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.065667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.065947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.066216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.076763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.078249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:52.093279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:52.094275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:52.100208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:52.100208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:52.100208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:52.100208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 531/1066] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:52.100446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.205698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46fcd-fdfc-4010-aa79-8200a81c2bc5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.240037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.240546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.240876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.241419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.242040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:52.242394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.243795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.259595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 536/1067] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:52.261249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.285836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.320203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.376086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d753-5b01-4756-afed-e5b963c286c9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.403002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254e3e4-f0ca-48cf-8670-2be526b2c4ce None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.414946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.415684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.415964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.416591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.424478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.426110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:52.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:52.438826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:52.439871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 532/1068] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:52.441157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.441986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.442390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.442783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.445229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.457422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:52.462272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:52.463194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:52.464074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:52.468552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 537/1069] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:52.469459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.496635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.559250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9bcd8-fab3-4770-8e87-18c7128c7208 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.579604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.596135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.596753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.597032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.597301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.598082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:52.598387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.599415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921c70b-f96a-4f62-b3a5-26c11e73fdae None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.599806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b66f4-f816-43fc-a75d-03a333b59378 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.618868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 533/1070] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:52.626742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ae13-3197-4979-af59-96f1469184bd None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.627246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ae13-3197-4979-af59-96f1469184bd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.627577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49ae13-3197-4979-af59-96f1469184bd None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.629543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 534/1071] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:52.630542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49ae13-3197-4979-af59-96f1469184bd None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.638423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.639031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.639310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.639576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.640238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:52.640535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.641944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123ae3f-ec80-410b-9b08-51c8bd631d15 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.651844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 538/1072] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:52.652995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.653278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.653581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.670442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:52.671626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:52.736389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 539/1073] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:52.737640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.738456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49ae13-3197-4979-af59-96f1469184bd None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.746076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.776091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.776714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.776992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.777258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.787933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.789246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:52.803721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:52.804803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:52.806101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:52.806101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:52.806101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:52.806101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 535/1074] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:52.811277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.826396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:52.853828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9dfb2-26cc-4f36-8ed4-b11dc735d21a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.895089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.896089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.896364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.896632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] PATH_INFO: `/v3/users/305e8f67376d4a59bf38b118e08de53e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.897795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] RBAC: Authorizing `identity:get_user(user_id=305e8f67376d4a59bf38b118e08de53e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.899225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.905990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 540/1075] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/users/305e8f67376d4a59bf38b118e08de53e => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:52.906862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:52.931748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1044782-9a1f-4bc7-ae93-b389c70e798f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:52.965710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:52.966358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:52.966642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:52.966919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:52.967557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:52.967860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:52.969221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:52.982810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 536/1076] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:52.988433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.003654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.017032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7fe51-ff2e-4caf-8d6a-ea3604c472cc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.050911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.051534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.051807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.052082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.053178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.054697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.056334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 541/1077] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:53.057121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.069122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.089605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc2275e-ae3a-4b9a-9d45-ecfb0d55a9fb None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.122593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.123217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.123494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.123762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.130226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.131693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:53.142687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:53.143617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 537/1078] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:53.144532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.157556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22882e-0a1f-4f0e-b745-c94f0677063a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.190896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.191493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.191766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.192031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.223086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.247898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960a5c3-a241-46e7-937e-8ce189f2bcc4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.257996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.259447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.270828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.281470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.282666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.282942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.283216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85/users/305e8f67376d4a59bf38b118e08de53e/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.285190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] RBAC: Authorizing `identity:create_grant(project_id=c7967de8afca40509e282d92f963da85, user_id=305e8f67376d4a59bf38b118e08de53e, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.286659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.300913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 538/1079] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:53 2022] PUT /identity/v3/projects/c7967de8afca40509e282d92f963da85/users/305e8f67376d4a59bf38b118e08de53e/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:08:53.302656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.389074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 542/1080] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:53.394719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.420252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138288d-024b-42a2-a387-bfc8fdc55fcf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.460437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.461149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.461538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.461877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.462674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:53.463054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.464574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.466392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.483870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 539/1081] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:53.485235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.520062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd168d8c-9aed-44ae-8877-3da7de8cce3b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.531235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:53.557503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.558132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.558408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.558679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.569586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.571030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:53.585647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:53.586683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:53.587599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:53.587599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:53.587599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:53.587599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 543/1082] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:53.592560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:53.600809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c9d9b-1447-47fe-96a3-efb338690fe9 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.637941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.638736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.639082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.639425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/ff04d4ba3aa04ce482363e1589fff680` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.641700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=9ddf36f45acc45fe99073dec8c3ee497, role_id=ff04d4ba3aa04ce482363e1589fff680)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.643134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b83b2d-3eef-480d-be44-fe3bea6c4d55 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.657782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 540/1083] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:08:53 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/9ddf36f45acc45fe99073dec8c3ee497/roles/ff04d4ba3aa04ce482363e1589fff680 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:08:53.700851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b123d8-3e2c-4e60-bc53-ee662e93b11d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:53.738905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:53.739507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:53.739776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:53.740058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:53.740729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:53.741123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:53.742608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bf40b-0270-41a7-8d91-e0e4cb2b9259 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:53.756490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 544/1084] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:55.280126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626fb0-c11e-4f91-af3b-1f8159806828 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.280684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626fb0-c11e-4f91-af3b-1f8159806828 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.280684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41626fb0-c11e-4f91-af3b-1f8159806828 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.282193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 541/1085] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:55.287668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a9c3-fd2a-47ef-b19f-f0fab58df016 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.288083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a9c3-fd2a-47ef-b19f-f0fab58df016 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.288226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158a9c3-fd2a-47ef-b19f-f0fab58df016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.307265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f158a9c3-fd2a-47ef-b19f-f0fab58df016 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:55.308463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f158a9c3-fd2a-47ef-b19f-f0fab58df016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:55.327416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:55.381641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 545/1086] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:55.552690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b6bc-4bf8-4a9a-8b9a-f399f32e34a1 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.552965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b6bc-4bf8-4a9a-8b9a-f399f32e34a1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.553336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b6bc-4bf8-4a9a-8b9a-f399f32e34a1 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.555315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 542/1087] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:55.561816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.562127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.562425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.581473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:55.582676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:55.643203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b6bc-4bf8-4a9a-8b9a-f399f32e34a1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:55.651932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 546/1088] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:55.701080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:55.750728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b6bc-4bf8-4a9a-8b9a-f399f32e34a1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:55.785949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:55.786559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.786837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.787107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.797627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:55.802353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:55.803380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:55.804735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 543/1089] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:08:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:55.809616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:55.892033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:55.912536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94bfa2-e597-4d3d-9ae2-5847670d5e2e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:55.917221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:55.950169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:55.950782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:55.951060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:55.951332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:55.952000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:55.952302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:55.953707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:55.963005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 547/1090] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:08:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:55.968810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.027569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc5dbe-9e43-4b34-874b-0e3c1231bdcf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.042555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.069154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.069830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.070105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.070368 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.075756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b43710-88d0-40fa-940c-d549b4c5558d None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.084709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:08:56.090020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:56.091158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:56.092229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 544/1091] 10.222.0.61 () {56 vars in 1120 bytes} [Sat Aug 27 02:08:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:56.097492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.114658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.115287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.115561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.115826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] PATH_INFO: `/v3/users/305e8f67376d4a59bf38b118e08de53e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.116972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=305e8f67376d4a59bf38b118e08de53e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.118434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.120058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 548/1092] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:08:55 2022] GET /identity/v3/users/305e8f67376d4a59bf38b118e08de53e => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:56.125818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.140224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.195913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542b778-23ee-4e05-b6ca-aa8265264ecf None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.226000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16387b5e-589d-4bdd-8550-b90f85c74aa0 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.232911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.233581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.233858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.234129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.234794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:56.235092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.236479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.246482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 545/1093] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:56.250564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.259344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.259954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.260230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.260497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.284954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.330002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.331381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.346165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.352371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ce068-b226-4ee0-a791-506fd44c0e8f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.392413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.393050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.393365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.393636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.404916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.406380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:56.421428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:56.422561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:56.423547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:56.423547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:56.423547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:56.423547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 546/1094] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:56.428489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.440086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 549/1095] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:56.445956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.514561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.529177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9f737-7e91-4a8a-a8ab-2fbc622c8ab7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.544729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4023a-3339-42ad-aa85-3274c8a346de None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.558021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.564613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.565222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.565532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.565808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.566451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:56.566751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.568150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.579783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 547/1096] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:56.580000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.580631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.580857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.581134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.582288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.583705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.585360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 550/1097] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:56.585517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.591174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.683752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad2d23-fe11-4ecb-91da-bb4122dcad35 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.691306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe3615-8cab-46f3-b8ef-8a29ae029e89 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.716922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.717567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.717843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.718106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.725099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.726822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.728239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.728832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.729104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.729673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.730112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=c7967de8afca40509e282d92f963da85, user.id=305e8f67376d4a59bf38b118e08de53e) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:56.730413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.731811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.737887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 551/1098] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/role_assignments?user.id=305e8f67376d4a59bf38b118e08de53e&scope.project.id=c7967de8afca40509e282d92f963da85&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:08:56.739136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:56.740141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:08:56.741156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 548/1099] 10.222.0.61 () {56 vars in 1093 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:08:56.746648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.797918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:56.857510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ce69a-6c60-463e-88e6-c23fb60a6da7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:56.893386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:56.894013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:56.894288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:56.894555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:56.895271 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:56.895592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:56.897028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:56.915191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 552/1100] 10.222.0.61 () {56 vars in 1133 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:56.921633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:56.933307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:57.021023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af517c58-7de9-4fed-84f7-d74439aad2bc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:57.056040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:57.056647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:57.056925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:57.057192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:57.125950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:57.127302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:57.137075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:57.226031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 549/1101] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:08:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:08:57.232263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:57.332194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746419ba-ad4f-4682-9025-fd297e657d95 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:57.333912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:57.367298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:57.367921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:57.368205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:57.368472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:57.378717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:57.380102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:08:57.396652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:57.397993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:08:57.399001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:08:57.399001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:08:57.399001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:57.399001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 553/1102] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:57.404089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:57.501821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a6811-a97a-4488-8ca9-ec3ffc37bd88 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:57.511057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:57.536802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:57.537483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:57.537806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:57.538121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:57.538758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:57.539055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:57.540408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:57.551415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 550/1103] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:57.557155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:57.659580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f187-e832-41c8-9078-ea711168d930 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:57.693999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:57.694852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:57.695104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:57.695368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:57.702590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:57.704023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:08:57.715247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:08:57.716238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:08:57.717146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 554/1104] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:08:57.722331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:57.830413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e892ca-ba55-4177-b86f-e58898db3ea7 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:57.864697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:57.865301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:57.865675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:57.865874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:57.866568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:57.866869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:57.868305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace0b82-8d86-4e0a-a73c-8e4e00edfed7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:57.880271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 551/1105] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:08:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:57.886517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:57.903356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:57.988316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f097-58a4-4166-aac0-a9186b489f39 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:58.022769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:58.023369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:58.023644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:58.023919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:58.024952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] RBAC: Adding query filter params (role.id=ff04d4ba3aa04ce482363e1589fff680, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=9ddf36f45acc45fe99073dec8c3ee497) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:08:58.025254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:58.026704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f75ea-5370-4b06-a20d-bae5ae8b691c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:58.032345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 555/1106] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:08:57 2022] GET /identity/v3/role_assignments?user.id=9ddf36f45acc45fe99073dec8c3ee497&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=ff04d4ba3aa04ce482363e1589fff680 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:58.669031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb376810-31da-4a0e-9d49-67c53021face None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:58.669739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb376810-31da-4a0e-9d49-67c53021face None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:58.669739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb376810-31da-4a0e-9d49-67c53021face None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:58.670982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 552/1107] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:08:58.677944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:58.678481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:58.678717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:58.697707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:08:58.698873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:08:58.777289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 556/1108] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:08:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:08:59.053161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb376810-31da-4a0e-9d49-67c53021face None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:59.090393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:59.169526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb376810-31da-4a0e-9d49-67c53021face None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:59.210207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:59.211012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:59.211383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:59.211738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:59.213751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:59.215947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839de90-9bf2-441e-97c9-22f9845fa0b7 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:59.218419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 553/1109] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:08:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:08:59.224455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:08:59.235040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:08:59.330535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb038182-6d2c-48f0-b2ce-202acaa7896e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:08:59.373789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:08:59.374714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:08:59.375063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:08:59.375467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:08:59.376385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:08:59.378194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35511d-d5f7-416e-bbd8-42c74de2ac71 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:08:59.403161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 557/1110] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:08:59 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:09:01.317323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4b81-c9f7-4130-af6b-c6648d13bbd2 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:01.317944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4b81-c9f7-4130-af6b-c6648d13bbd2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:01.317944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb4b81-c9f7-4130-af6b-c6648d13bbd2 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:01.319307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 554/1111] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:01.324590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:01.325045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:01.325138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:01.344197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:01.345386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:01.407635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:01.419800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 558/1112] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:09:01.682613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4b81-c9f7-4130-af6b-c6648d13bbd2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:01.797302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:01.804970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb4b81-c9f7-4130-af6b-c6648d13bbd2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:01.839698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:01.840305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:01.840575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:01.840839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] PATH_INFO: `/v3/roles/c388505e96244703b71034784851f8f0` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:01.842484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] RBAC: Authorizing `identity:get_role(role_id=c388505e96244703b71034784851f8f0)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:01.843837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:01.845140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 555/1113] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:01 2022] GET /identity/v3/roles/c388505e96244703b71034784851f8f0 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:01.851845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:01.965854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2411e-357a-4396-97e1-7937d798a83c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:02.001170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:02.001803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:02.002082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:02.002353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] PATH_INFO: `/v3/users/3d59e3535d8c43c7ac01b85464d79aaa` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:02.015856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] RBAC: Authorizing `identity:get_user(user_id=3d59e3535d8c43c7ac01b85464d79aaa)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:02.017293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:02.018899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 559/1114] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:01 2022] GET /identity/v3/users/3d59e3535d8c43c7ac01b85464d79aaa => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:02.026486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:02.132120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c6eb6-61ff-4f13-8a0c-6bc72cc3d419 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:02.174604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:02.175191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:02.175463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:02.175727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:02.209268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:02.254982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:02.256345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:02.358549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 556/1115] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:02.367361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:02.420701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:02.480031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad8bb9-f6df-4e3a-a80e-aa8f59fa0911 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:02.515810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:02.516378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:02.516650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:02.516916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:02.518052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:02.519466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeba0aa-e92e-4e04-948a-e688fd3a15bf None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:02.521100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 560/1116] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:02 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:02.528001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:02.606205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:02.649950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c427a-1663-404c-8fe7-e26a5c5535b0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:02.685684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:02.686273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:02.686551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:02.686819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:02.687631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=c7967de8afca40509e282d92f963da85, user.id=3d59e3535d8c43c7ac01b85464d79aaa) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:02.687863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:02.689293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df1321a-b47a-4b29-a8df-10c51d788a00 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:02.694836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 557/1117] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:02 2022] GET /identity/v3/role_assignments?user.id=3d59e3535d8c43c7ac01b85464d79aaa&scope.project.id=c7967de8afca40509e282d92f963da85&role.id=c388505e96244703b71034784851f8f0 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:04.541323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1efc-88a4-47c3-a054-192e2228e266 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:04.542165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1efc-88a4-47c3-a054-192e2228e266 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:04.542165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e1efc-88a4-47c3-a054-192e2228e266 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:04.544290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 561/1118] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:04.551926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:04.552366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:04.552457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:04.571482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:04.572776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:04.659648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 558/1119] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:04.949704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e1efc-88a4-47c3-a054-192e2228e266 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:05.071861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e1efc-88a4-47c3-a054-192e2228e266 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:05.092603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:05.109586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:05.110197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:05.110475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:05.110737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] PATH_INFO: `/v3/roles/c388505e96244703b71034784851f8f0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:05.112137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] RBAC: Authorizing `identity:get_role(role_id=c388505e96244703b71034784851f8f0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:05.113534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:05.114880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 562/1120] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:04 2022] GET /identity/v3/roles/c388505e96244703b71034784851f8f0 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:05.121641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:05.184782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:05.232570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9c39a-015a-4092-9f5e-be24b85f0da8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:05.266872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:05.267500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:05.267783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:05.268058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] PATH_INFO: `/v3/users/3d59e3535d8c43c7ac01b85464d79aaa` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:05.269203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=3d59e3535d8c43c7ac01b85464d79aaa)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:05.270680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:05.272289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 559/1121] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:05 2022] GET /identity/v3/users/3d59e3535d8c43c7ac01b85464d79aaa => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:05.278922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:05.381866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af05cf0-9561-439f-945a-e9dcfbe88a12 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:05.417114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:05.417754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:05.418025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:05.418290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:05.419369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:05.420789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba407b45-bdb0-4c40-bb6a-ae6ec47e9ba5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:05.422435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 563/1122] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:05 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:09:05.428744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:05.542173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb5dd-34fe-4818-97e8-d71177647ab8 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:05.573873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:05.583524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:05.584183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:05.584455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:05.584760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85/users/3d59e3535d8c43c7ac01b85464d79aaa/roles/c388505e96244703b71034784851f8f0` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:05.586992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] RBAC: Authorizing `identity:create_grant(project_id=c7967de8afca40509e282d92f963da85, user_id=3d59e3535d8c43c7ac01b85464d79aaa, role_id=c388505e96244703b71034784851f8f0)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:05.588423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd45ad-7059-4d10-9a31-500105a1305a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:05.602419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 560/1123] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:09:05 2022] PUT /identity/v3/projects/c7967de8afca40509e282d92f963da85/users/3d59e3535d8c43c7ac01b85464d79aaa/roles/c388505e96244703b71034784851f8f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:09:07.446810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef6a3-5b99-45a6-ade4-cc59c98584e9 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:07.447392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef6a3-5b99-45a6-ade4-cc59c98584e9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:07.447392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ef6a3-5b99-45a6-ade4-cc59c98584e9 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:07.448681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 564/1124] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:07.454976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:07.455703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:07.455830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:07.482028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:07.483217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:07.555447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 561/1125] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:07.823063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ef6a3-5b99-45a6-ade4-cc59c98584e9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:07.882869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:07.928563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ef6a3-5b99-45a6-ade4-cc59c98584e9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:07.963500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:07.964122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:07.964398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:07.964663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] PATH_INFO: `/v3/roles/c388505e96244703b71034784851f8f0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:07.966117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] RBAC: Authorizing `identity:get_role(role_id=c388505e96244703b71034784851f8f0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:07.967479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:07.968798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 565/1126] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:07 2022] GET /identity/v3/roles/c388505e96244703b71034784851f8f0 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:07.975364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:08.090306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44527c8-1748-42cb-9695-c5ae5fd2b0af None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:08.107691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:08.132400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:08.133028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:08.133308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:08.133597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] PATH_INFO: `/v3/users/3d59e3535d8c43c7ac01b85464d79aaa` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:08.134786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] RBAC: Authorizing `identity:get_user(user_id=3d59e3535d8c43c7ac01b85464d79aaa)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:08.136226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:08.137839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 562/1127] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:07 2022] GET /identity/v3/users/3d59e3535d8c43c7ac01b85464d79aaa => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:08.143823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:08.251260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc9340-5ae8-48e6-8ef3-1e0edbda4bcc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:08.275856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:08.288345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:08.288948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:08.289221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:08.289516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:08.365663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:08.367052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:08.469914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 566/1128] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:08.478847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:08.608769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907ce9-fc61-471c-8659-12a1c0123918 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:08.648909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:08.649434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:08.650062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:08.650329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] PATH_INFO: `/v3/projects/c7967de8afca40509e282d92f963da85` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:08.651481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] RBAC: Authorizing `identity:get_project(project_id=c7967de8afca40509e282d92f963da85)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:08.652914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd71df7-6ffb-45b5-b073-22daa4c96459 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:08.654599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 563/1129] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:08 2022] GET /identity/v3/projects/c7967de8afca40509e282d92f963da85 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:08.664101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:08.688956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:08.781283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68e487-93e8-4666-8b15-e6ac15a81f11 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:08.826735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:08.827339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:08.827615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:08.827883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:08.828609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] RBAC: Adding query filter params (role.id=c388505e96244703b71034784851f8f0, scope.project.id=c7967de8afca40509e282d92f963da85, user.id=3d59e3535d8c43c7ac01b85464d79aaa) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:08.828917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:08.830387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360bd2f8-6ec9-416f-abd6-8825398ff7c6 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:08.836086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 567/1130] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:08 2022] GET /identity/v3/role_assignments?user.id=3d59e3535d8c43c7ac01b85464d79aaa&scope.project.id=c7967de8afca40509e282d92f963da85&role.id=c388505e96244703b71034784851f8f0 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:10.717149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2fd0b-a9b0-431a-b88f-388c3f73e356 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:10.717740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2fd0b-a9b0-431a-b88f-388c3f73e356 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:10.717740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2fd0b-a9b0-431a-b88f-388c3f73e356 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:10.719711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 564/1131] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:10.728359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:10.728775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:10.728923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:10.753126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:10.754346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:10.837499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 568/1132] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:11.113089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2fd0b-a9b0-431a-b88f-388c3f73e356 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:11.170242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:11.221229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2fd0b-a9b0-431a-b88f-388c3f73e356 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:11.261229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:11.261797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:11.262074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:11.262346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:11.263584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:11.265027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b4e696-38a7-40c4-9435-8b31ae5b3daf None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:11.266637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 565/1133] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:09:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:11.272982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:11.294392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:11.382245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da069ba1-7899-429f-891f-fa298b3e46d5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:11.417428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:11.418032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:11.418304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:11.418571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:11.419221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:11.420647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a23740-1e87-4071-b7a7-dd066b8d3519 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:11.450558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 569/1134] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:09:11 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:09:13.391051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f024c42-0fdc-4c4a-a7ec-e694341683ab None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:13.391852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f024c42-0fdc-4c4a-a7ec-e694341683ab None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:13.391991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f024c42-0fdc-4c4a-a7ec-e694341683ab None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:13.394443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 566/1135] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:13.400279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:13.400706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:13.400803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:13.420119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:13.421306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:13.487643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:13.494285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 570/1136] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:13.766773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f024c42-0fdc-4c4a-a7ec-e694341683ab None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:13.885670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f024c42-0fdc-4c4a-a7ec-e694341683ab None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:13.906223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:13.921771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:13.922385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:13.922665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:13.922933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:13.924100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:13.925556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690e90-c1ef-4d14-80b6-cbaf44bbd91c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:13.927115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 567/1137] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:09:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:13.933310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:14.044115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f89c5-41be-414c-99e1-8a632d2281af None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:14.082316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:14.082910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:14.083183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:14.083445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:14.084102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:14.085963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5a63d-292b-4dae-9584-3f0fb0e0d67a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:14.111887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 571/1138] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:09:13 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:09:16.031960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a8b2-6be2-42c4-b7f5-ed4618bfb39c None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:16.032907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a8b2-6be2-42c4-b7f5-ed4618bfb39c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:16.032907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410a8b2-6be2-42c4-b7f5-ed4618bfb39c None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:16.035054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 568/1139] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:16.043554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:16.044297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:16.044427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:16.067952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:16.069132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:16.124069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:16.143282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 572/1140] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:16.407087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410a8b2-6be2-42c4-b7f5-ed4618bfb39c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:16.524984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410a8b2-6be2-42c4-b7f5-ed4618bfb39c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:16.560405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:16.561077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:16.561256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:16.561582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:16.571944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:16.577121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:16.578255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:16.579475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 569/1141] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:16.586665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:16.699724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93bfd9-f89e-4880-a67d-02e7224e6e7e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:16.735609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:16.736222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:16.736496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:16.736766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:16.737423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:16.737808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:16.739268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:16.748434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 573/1142] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:16.757972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:16.814350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:16.876046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5d721-28e4-4d02-b8d0-b8dbb6fb40dc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:16.915565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:16.916272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:16.916459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:16.916792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] PATH_INFO: `/v3/users/9d4f99c0cfb84ce687763bd7401cfd21` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:16.932276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=9d4f99c0cfb84ce687763bd7401cfd21)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:16.933729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:16.935330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 570/1143] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:16 2022] GET /identity/v3/users/9d4f99c0cfb84ce687763bd7401cfd21 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:16.942122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:17.002153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:17.059904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ce2f7-b688-455c-ae03-c6eb23c783d3 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:17.094760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:17.095390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:17.095644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:17.095915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:17.180319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:17.182612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:17.238494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:17.299229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 574/1144] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:17.305428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:17.411590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f59a1-5e39-4f30-a6c6-1e6125e2a7b3 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:17.418853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:17.450851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:17.451475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:17.451760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:17.452031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] PATH_INFO: `/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:17.453201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] RBAC: Authorizing `identity:get_project(project_id=79cfcdd66b7d44b98c3fd1cdce1a8fde)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:17.454674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214afd04-89c6-46b3-8175-225889aab4d9 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:17.456293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 571/1145] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:17 2022] GET /identity/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:17.462670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:17.571901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb29f-d20d-42d0-858c-1fd80526f922 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:17.609715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:17.610305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:17.610573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:17.610840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:17.611558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=79cfcdd66b7d44b98c3fd1cdce1a8fde, user.id=9d4f99c0cfb84ce687763bd7401cfd21) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:17.611861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:17.613279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d31ba-4ca5-4d8d-b299-952e168b9454 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:17.618758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 575/1146] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:17 2022] GET /identity/v3/role_assignments?user.id=9d4f99c0cfb84ce687763bd7401cfd21&scope.project.id=79cfcdd66b7d44b98c3fd1cdce1a8fde&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:19.476796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf425-7201-4938-a53e-f2feddd87d3d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:19.477657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf425-7201-4938-a53e-f2feddd87d3d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:19.477657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf425-7201-4938-a53e-f2feddd87d3d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:19.479835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 572/1147] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:19.486392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:19.486836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:19.486953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:19.510555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:19.511716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:19.519724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:19.600250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 576/1148] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:19.879290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf425-7201-4938-a53e-f2feddd87d3d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:20.016857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf425-7201-4938-a53e-f2feddd87d3d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:20.064446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:20.065350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:20.065846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:20.066283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:20.080894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:20.085742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:20.089461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:20.090535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 573/1149] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:20.095458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:20.193354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57db6-c45c-4d0f-90c5-14b4962cdae9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:20.231851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:20.232497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:20.232757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:20.233033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:20.233793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:20.234086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:20.235448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:20.244144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 577/1150] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:20.250462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:20.289867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:20.375699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad2228-1383-4e8e-a073-dd55fa6f7389 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:20.419676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:20.420344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:20.420625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:20.420897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] PATH_INFO: `/v3/users/9d4f99c0cfb84ce687763bd7401cfd21` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:20.422114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] RBAC: Authorizing `identity:get_user(user_id=9d4f99c0cfb84ce687763bd7401cfd21)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:20.423557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:20.425346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 574/1151] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:20 2022] GET /identity/v3/users/9d4f99c0cfb84ce687763bd7401cfd21 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:20.432048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:20.437574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:20.559781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943a3c-8c49-4653-bcbd-dc92e9f98a31 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:20.596516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:20.597142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:20.597422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:20.597703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] PATH_INFO: `/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:20.598909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] RBAC: Authorizing `identity:get_project(project_id=79cfcdd66b7d44b98c3fd1cdce1a8fde)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:20.600375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e50ddd-585c-4d3c-a6ad-5d43a748c486 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:20.602052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 578/1152] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:20 2022] GET /identity/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:20.608689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:20.718947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b20fa2-1245-4ae1-99b7-6cbad3f0c70b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:20.720474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:20.758810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:20.759455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:20.759731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:20.760004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] PATH_INFO: `/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde/users/9d4f99c0cfb84ce687763bd7401cfd21/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:20.761908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] RBAC: Authorizing `identity:create_grant(project_id=79cfcdd66b7d44b98c3fd1cdce1a8fde, user_id=9d4f99c0cfb84ce687763bd7401cfd21, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:20.763331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee8faf-8cdd-49a9-b535-f7bf86dcb26a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:20.777945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 575/1153] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:09:20 2022] PUT /identity/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde/users/9d4f99c0cfb84ce687763bd7401cfd21/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:09:22.726699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a672-3a58-48a9-8ba7-c378f838de6c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:22.727285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a672-3a58-48a9-8ba7-c378f838de6c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:22.727285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a672-3a58-48a9-8ba7-c378f838de6c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:22.728566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 579/1154] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:22.735400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:22.735980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:22.736435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:22.762167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:22.763776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:22.859688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 576/1155] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:23.137044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a672-3a58-48a9-8ba7-c378f838de6c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:23.227298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:23.260269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44a672-3a58-48a9-8ba7-c378f838de6c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:23.296882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:23.297530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:23.297810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:23.298077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:23.309197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:23.313977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:23.315078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:09:23.316017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 580/1156] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:23.321702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:23.414361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:23.424053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d8d02-fa2d-40d2-b372-289c8688e5b8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:23.458708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:23.459356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:23.459626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:23.459889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:23.460537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:23.460834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:23.462212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:23.470203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 577/1157] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:23.479191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:23.595687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283b844-6dd7-4435-ba87-77a08d76012b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:23.625474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:23.632483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:23.633122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:23.633405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:23.633784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] PATH_INFO: `/v3/users/9d4f99c0cfb84ce687763bd7401cfd21` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:23.635784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] RBAC: Authorizing `identity:get_user(user_id=9d4f99c0cfb84ce687763bd7401cfd21)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:23.638142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:23.640482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 581/1158] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:23 2022] GET /identity/v3/users/9d4f99c0cfb84ce687763bd7401cfd21 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:23.648049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:23.766078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfd009-73eb-4ad6-bf3f-0f9374a6d73b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:23.799682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:23.800277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:23.800552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:23.800823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:23.824853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:23.885045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:23.886531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:23.988462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 578/1159] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:23.997914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:24.109341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2c5df-f120-4cea-ac35-52dcc091d56f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:24.143522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:24.144131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:24.144406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:24.144679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] PATH_INFO: `/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:24.145874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] RBAC: Authorizing `identity:get_project(project_id=79cfcdd66b7d44b98c3fd1cdce1a8fde)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:24.147364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0b57-c476-45c7-bc86-cb5e92cfdda1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:24.148990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 582/1160] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:23 2022] GET /identity/v3/projects/79cfcdd66b7d44b98c3fd1cdce1a8fde => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:24.158790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:24.220185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:24.279085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caddbf-e75c-49f1-900f-894fe2d1fcc0 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:24.315061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:24.315656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:24.315934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:24.316208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:24.316935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=79cfcdd66b7d44b98c3fd1cdce1a8fde, user.id=9d4f99c0cfb84ce687763bd7401cfd21) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:24.317224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:24.318741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d5be2-78db-41c1-a664-a2c33e8cb384 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:24.324954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 579/1161] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:24 2022] GET /identity/v3/role_assignments?user.id=9d4f99c0cfb84ce687763bd7401cfd21&scope.project.id=79cfcdd66b7d44b98c3fd1cdce1a8fde&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:26.315147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7ac8-8093-4de4-875f-302c387c2a47 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:26.315591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7ac8-8093-4de4-875f-302c387c2a47 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:26.315680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da7ac8-8093-4de4-875f-302c387c2a47 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:26.317849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 583/1162] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:26.323455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:26.323868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:26.323998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:26.344222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:26.345419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:26.420855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 580/1163] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:26.688888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da7ac8-8093-4de4-875f-302c387c2a47 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:26.776562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:26.814186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da7ac8-8093-4de4-875f-302c387c2a47 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:26.847917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:26.848501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:26.848772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:26.849039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:26.917257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:26.918712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:26.995013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:27.030735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 584/1164] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:27.039596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:27.094650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:27.157977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ccfe5-3985-4d3a-bd26-5e2abba8d2dc None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:27.199408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:27.200022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:27.200298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:27.200565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:27.207786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:27.209298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ff1bc137-0e8b-4afa-8253-26fe0be5aa18 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:27.221645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:27.222936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 27 02:09:27.224032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:27.225573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 581/1165] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:09:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:27.228884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:27.348668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3e95-a617-45df-b4d9-204a88ac3c36 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:27.388962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:27.389581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:27.389856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:27.390126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:27.390756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:27.391219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:27.392587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e1caf-776f-4058-9009-9753591fdc23 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:27.400371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 585/1166] 10.222.0.61 () {56 vars in 1115 bytes} [Sat Aug 27 02:09:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:29.290702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765318-35cb-4d45-a5b8-a84025f942e2 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:29.291283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765318-35cb-4d45-a5b8-a84025f942e2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:29.291283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e765318-35cb-4d45-a5b8-a84025f942e2 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:29.292570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 582/1167] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:29.297948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd721-f5bb-4f20-8a4f-917c17787937 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:29.298408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd721-f5bb-4f20-8a4f-917c17787937 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:29.298537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd721-f5bb-4f20-8a4f-917c17787937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:29.317196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f7afd721-f5bb-4f20-8a4f-917c17787937 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:29.318495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f7afd721-f5bb-4f20-8a4f-917c17787937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:29.345635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:29.388012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 586/1168] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:29.648161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765318-35cb-4d45-a5b8-a84025f942e2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:29.750271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e765318-35cb-4d45-a5b8-a84025f942e2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:29.759531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:29.785121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:29.785750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:29.786016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:29.786280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:29.786975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:29.788338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95956c65-149e-4325-88ad-6418c73e2820 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:29.804130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 583/1169] 10.222.0.61 () {60 vars in 1138 bytes} [Sat Aug 27 02:09:29 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:09:31.679093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012f74-0ea8-48c7-8383-4dec5e968e46 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:31.679684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012f74-0ea8-48c7-8383-4dec5e968e46 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:31.679856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60012f74-0ea8-48c7-8383-4dec5e968e46 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:31.681085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 587/1170] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:31.686686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:31.687090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:31.687232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:31.706285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:31.707482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:31.778197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 584/1171] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:32.045326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60012f74-0ea8-48c7-8383-4dec5e968e46 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:32.150548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60012f74-0ea8-48c7-8383-4dec5e968e46 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:32.185217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:32.185863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:32.186120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:32.186383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] PATH_INFO: `/v3/domains/3a138da6c30c4a1bb0d98b46c5a28ee7` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:32.196789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3a138da6c30c4a1bb0d98b46c5a28ee7)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:32.198261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4bdf3-e4ec-4593-ab9f-1ac024cf7257 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:32.199871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 588/1172] 10.222.0.61 () {56 vars in 1183 bytes} [Sat Aug 27 02:09:32 2022] GET /identity/v3/domains/3a138da6c30c4a1bb0d98b46c5a28ee7 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:32.205944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:32.303036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:32.307185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1365a1-90a7-42b7-a035-86d865abb830 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:32.344282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:32.344899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:32.345212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:32.345515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:32.346172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:32.347601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a128-3da8-4e1e-8592-2eda2ea3c107 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:32.375690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 585/1173] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:09:32 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:09:34.342655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988103-2633-46e0-a15b-5cecaf61feae None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:34.343468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988103-2633-46e0-a15b-5cecaf61feae None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:34.343468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988103-2633-46e0-a15b-5cecaf61feae None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:34.345530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 589/1174] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:34.353320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:34.353764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:34.353933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:34.382012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:34.383196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:34.455179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 586/1175] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:34.755710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988103-2633-46e0-a15b-5cecaf61feae None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:34.783051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:34.867765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988103-2633-46e0-a15b-5cecaf61feae None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:34.909659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:34.910283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:34.910555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:34.910822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] PATH_INFO: `/v3/domains/3a138da6c30c4a1bb0d98b46c5a28ee7` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:34.912001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3a138da6c30c4a1bb0d98b46c5a28ee7)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:34.913462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40873e-a8b3-498d-9255-ad394048d009 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:34.915070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 590/1176] 10.222.0.61 () {56 vars in 1183 bytes} [Sat Aug 27 02:09:34 2022] GET /identity/v3/domains/3a138da6c30c4a1bb0d98b46c5a28ee7 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:34.922193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:35.011706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:35.034833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04978d19-977c-46d7-b53e-399a4b609495 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:35.080134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:35.081016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:35.081443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:35.081766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:35.082714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:35.084923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0331a-50ba-430f-bb8f-3a6cbea0fceb None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:35.118090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 587/1177] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:09:34 2022] POST /identity/v3/users => generated 311 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:09:37.048485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb902f-1e00-4eca-8d8e-023b7ac7ae8e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:37.049414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb902f-1e00-4eca-8d8e-023b7ac7ae8e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:37.049414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb902f-1e00-4eca-8d8e-023b7ac7ae8e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:37.051401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 591/1178] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:37.060067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:37.060757 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:37.060869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:37.088464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:37.089682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:37.165737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 588/1179] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:37.431475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb902f-1e00-4eca-8d8e-023b7ac7ae8e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:37.548009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:37.560049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb902f-1e00-4eca-8d8e-023b7ac7ae8e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:37.594797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:37.595413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:37.595690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:37.595961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:37.606725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:37.611445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:37.612472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:09:37.613668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 592/1180] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:37.618829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:37.685281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:37.725026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d1e9f-40f0-42a2-adb3-cf28830838d2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:37.762636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:37.763238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:37.763511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:37.763775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:37.764445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:37.764740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:37.766137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:37.776588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 589/1181] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:37.782595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:37.904364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb91a5c-af9b-487a-9fc5-197edf00183f None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:37.946455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:37.947095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:37.947371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:37.947634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] PATH_INFO: `/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:37.964218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] RBAC: Authorizing `identity:get_user(user_id=dc983bdd9f6e4b55a8e353f62e86b0da)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:37.965706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:37.967486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 593/1182] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:37 2022] GET /identity/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:37.974319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:38.083597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75290-1aa8-4665-be11-bcd692fe555d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:38.110167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:38.120097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:38.120726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:38.121019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:38.121340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:38.191735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:38.193129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:38.305597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 590/1183] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:38.311909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:38.323432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:38.415292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428b94-e8f2-4fc9-afdd-8fc9540f7f08 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:38.450241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:38.450787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:38.451063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:38.451333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] PATH_INFO: `/v3/projects/100ef401b9094d5bb561fcf966739ebb` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:38.452483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] RBAC: Authorizing `identity:get_project(project_id=100ef401b9094d5bb561fcf966739ebb)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:38.453958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8112c1-9581-4e52-9164-cb68be8a3e68 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:38.455576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 594/1184] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:38 2022] GET /identity/v3/projects/100ef401b9094d5bb561fcf966739ebb => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:38.463155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:38.497575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:38.574514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee85d8e-61f1-4aac-9e5f-0429de4a2cdc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:38.613375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:38.614008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:38.614291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:38.614599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:38.615376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=100ef401b9094d5bb561fcf966739ebb, user.id=dc983bdd9f6e4b55a8e353f62e86b0da) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:38.615689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:38.617129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba7c08-25fe-4284-aeaa-5adf7dfc5c98 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:38.622692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 591/1185] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:38 2022] GET /identity/v3/role_assignments?user.id=dc983bdd9f6e4b55a8e353f62e86b0da&scope.project.id=100ef401b9094d5bb561fcf966739ebb&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:40.470984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c46a-53fc-4a58-82c2-869be41a7c92 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:40.471560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c46a-53fc-4a58-82c2-869be41a7c92 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:40.471560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f3c46a-53fc-4a58-82c2-869be41a7c92 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:40.472880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 595/1186] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:40.479269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:40.479980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:40.480149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:40.502639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:40.503800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:40.574625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 592/1187] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:40.843185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c46a-53fc-4a58-82c2-869be41a7c92 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:40.922878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:40.964042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f3c46a-53fc-4a58-82c2-869be41a7c92 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:41.009362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:41.010006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:41.010277 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:41.010539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:41.021043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:41.026057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:41.027167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:09:41.028045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 596/1188] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:41.033532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:41.059994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:41.162130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb31a91-86ca-4066-99a3-69e9447005ac None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:41.202252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:41.202849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:41.203128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:41.203394 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:41.204053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:41.204352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:41.205736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:41.214455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 593/1189] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:41.223650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:41.342884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16c1e1-f7a8-4bc2-97d4-3e01bc97e8c9 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:41.378916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:41.379936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:41.379936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:41.380142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] PATH_INFO: `/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:41.381362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] RBAC: Authorizing `identity:get_user(user_id=dc983bdd9f6e4b55a8e353f62e86b0da)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:41.382824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:41.384419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 597/1190] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:41 2022] GET /identity/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:41.396311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:41.493192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:41.521148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207079ac-2c53-4475-8b3e-929e45792db4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:41.557154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:41.557804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:41.558153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:41.558333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] PATH_INFO: `/v3/projects/100ef401b9094d5bb561fcf966739ebb` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:41.560713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] RBAC: Authorizing `identity:get_project(project_id=100ef401b9094d5bb561fcf966739ebb)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:41.562359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da9852-1b26-4dc0-8ec1-3751bead9a8b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:41.564021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 594/1191] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:41 2022] GET /identity/v3/projects/100ef401b9094d5bb561fcf966739ebb => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:41.573977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:41.580029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:41.683937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad42c0-19e6-44e1-98cd-3194730830f5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:41.719222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:41.719873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:41.720149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:41.720424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] PATH_INFO: `/v3/projects/100ef401b9094d5bb561fcf966739ebb/users/dc983bdd9f6e4b55a8e353f62e86b0da/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:41.722624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] RBAC: Authorizing `identity:create_grant(project_id=100ef401b9094d5bb561fcf966739ebb, user_id=dc983bdd9f6e4b55a8e353f62e86b0da, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:41.724092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54527fe1-ed39-45a0-9fd5-677902943588 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:41.742414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 598/1192] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:09:41 2022] PUT /identity/v3/projects/100ef401b9094d5bb561fcf966739ebb/users/dc983bdd9f6e4b55a8e353f62e86b0da/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:09:43.587702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b779f9-c038-4936-a6b5-b2f6ed427b7e None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:43.588559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b779f9-c038-4936-a6b5-b2f6ed427b7e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:43.588559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b779f9-c038-4936-a6b5-b2f6ed427b7e None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:43.590772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 595/1193] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:09:43.597058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:43.597518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:43.597652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:43.616851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:09:43.618113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:09:43.680083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:43.693684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 599/1194] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:09:43.965238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b779f9-c038-4936-a6b5-b2f6ed427b7e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:44.073601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b779f9-c038-4936-a6b5-b2f6ed427b7e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:44.108896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:44.109530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:44.109806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:44.110076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:44.120557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:09:44.125563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:09:44.126723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:09:44.127949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 596/1195] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:09:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:09:44.133333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:44.245440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24b4ff-b8e6-425b-8024-9b9d752a6586 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:44.280972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:44.281587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:44.281844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:44.282109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:44.282757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:44.283051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:44.284411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:44.292478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 600/1196] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:44.302711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:44.323290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:44.414787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ac572-03ae-4874-a6e4-379ee2605199 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:44.450697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:44.451327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:44.451605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:44.451880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] PATH_INFO: `/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:44.453237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] RBAC: Authorizing `identity:get_user(user_id=dc983bdd9f6e4b55a8e353f62e86b0da)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:44.454731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:44.456324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 597/1197] 10.222.0.61 () {56 vars in 1177 bytes} [Sat Aug 27 02:09:44 2022] GET /identity/v3/users/dc983bdd9f6e4b55a8e353f62e86b0da => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:44.462639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:44.524631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:44.575612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb1e12-c0a7-4cdc-9765-40da10015cc5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:44.609931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:44.610503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:44.610781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:44.611052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:44.682120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:44.683562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:44.737637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:44.786399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 601/1198] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:09:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:09:44.792564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:44.884184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:44.905019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8798-b561-468d-b5b0-978c84cb07dc None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:44.940759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:44.941411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:44.941695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:44.941966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] PATH_INFO: `/v3/projects/100ef401b9094d5bb561fcf966739ebb` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:44.943161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] RBAC: Authorizing `identity:get_project(project_id=100ef401b9094d5bb561fcf966739ebb)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:44.944588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001927c7-79c5-4ca6-9048-9924ccee8692 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:44.946223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 598/1199] 10.222.0.61 () {56 vars in 1186 bytes} [Sat Aug 27 02:09:44 2022] GET /identity/v3/projects/100ef401b9094d5bb561fcf966739ebb => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:44.952708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:09:45.056755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cbe9d-8dc0-44b2-ad82-f13f719eef13 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:09:45.094473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:09:45.095084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:09:45.095356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:09:45.095620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:09:45.096334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=100ef401b9094d5bb561fcf966739ebb, user.id=dc983bdd9f6e4b55a8e353f62e86b0da) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:09:45.096637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:09:45.098090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8fd4a-b162-4514-94b1-9ddf9349341b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:09:45.104105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 602/1200] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:09:44 2022] GET /identity/v3/role_assignments?user.id=dc983bdd9f6e4b55a8e353f62e86b0da&scope.project.id=100ef401b9094d5bb561fcf966739ebb&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:09:54.936005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=26 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:09:55.101449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:40.602298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a3df-1ac2-4728-a15f-64e66e70f5bc None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:40.603028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a3df-1ac2-4728-a15f-64e66e70f5bc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:40.603028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417a3df-1ac2-4728-a15f-64e66e70f5bc None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:40.604242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 599/1201] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:10:40.610113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:40.610638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:40.610875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:40.632648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:10:40.633932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:10:40.721935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 603/1202] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:10:40.980571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a3df-1ac2-4728-a15f-64e66e70f5bc None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:41.115375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417a3df-1ac2-4728-a15f-64e66e70f5bc None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:41.163962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:41.165029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:41.165561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:41.166004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:41.178507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:41.179975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:41.199381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:41.200764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:41.201894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:41.201894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:41.201894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:41.201894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 600/1203] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:41.207208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:41.368760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee85ca4-d91b-407c-9224-222cf81c22f9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:41.422165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:41.433706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:41.434520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:41.434959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:41.435510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:41.436272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:41.436630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:41.438101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2569e-6860-4022-93aa-9de71e93731a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:41.452475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 604/1204] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:41.459444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:41.535711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:41.596782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37f77b-fc54-4af2-b302-0efa6b6560c2 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:41.640487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:41.641969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:41.642416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:41.642839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:41.643653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:41.645375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc8c8e-d930-46a5-9db0-3467d3614baa None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:41.671685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 601/1205] 10.222.0.61 () {60 vars in 1132 bytes} [Sat Aug 27 02:10:41 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:10:43.884228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea005-abe5-4934-ba1c-17509e953d6c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:43.884805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea005-abe5-4934-ba1c-17509e953d6c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:43.884805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ea005-abe5-4934-ba1c-17509e953d6c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:43.886316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 605/1206] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:10:43.892034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:43.892525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:43.892606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:43.912650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:10:43.913887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:10:43.988564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 602/1207] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:10:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 27 02:10:44.249198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea005-abe5-4934-ba1c-17509e953d6c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:44.376344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ea005-abe5-4934-ba1c-17509e953d6c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:44.415482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:44.416217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:44.416499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:44.416757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:44.432779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:10:44.439077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:44.440194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:44.441100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 606/1208] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:10:44.446420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:44.493468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:44.566783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e86a7d5-a145-4a02-bd19-8b632133f974 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:44.607738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:44.608748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:44.609029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:44.609295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:44.610033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:44.610330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:44.611748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:44.621632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 603/1209] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:44.627695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:44.683717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:44.743437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473af4cb-6546-4a65-809a-655ffc8985af None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:44.785571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:44.786297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:44.786653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:44.786939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:44.799577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:44.801096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:44.816938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:44.822788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:44.823935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:44.823935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:44.823935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:44.823935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 607/1210] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:44.825618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:44.941648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:44.944761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c31bb-cfce-4763-8791-bf8e47006b2c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:44.988972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:44.989849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:44.990102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:44.990505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:44.991187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:44.991493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:44.992920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:45.007075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 604/1211] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:45.012845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:45.121678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f33e6-3aac-4a67-bbb5-796b0f747169 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:45.123293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:45.161939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:45.162744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:45.163309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:45.163735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:45.171763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:45.173405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:10:45.188561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:45.189805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:45.190811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 608/1212] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:45.195914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:45.304953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda3a9b-2835-47ca-bf6a-5849617efc2b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:45.340994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:45.341677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:45.342018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:45.342227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:45.343037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:45.343351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:45.344787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:45.368353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 605/1213] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:10:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:45.374373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:45.492133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49182d3-86cf-43a6-9f32-35e0e9aa6aeb None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:45.530160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:45.530764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:45.531031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:45.531311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:45.565031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:45.613246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:45.614752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:45.738845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 609/1214] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:10:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:10:45.743305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:45.772085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:45.878247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c5176-2531-4f6c-913b-53bc29d6c81a None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:45.921975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:45.922683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:45.922973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:45.923247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:45.934578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:45.936623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:45.953062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:45.956069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:45.957200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:45.957200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:45.957200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:45.957200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 606/1215] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:45.960367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:46.029748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:46.071883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965fbb03-807b-402f-8e4d-1e365138e02b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:46.112011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:46.112727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:46.113035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:46.113331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:46.114037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:46.114309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:46.116036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:46.134215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 610/1216] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:46.135563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:46.219363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:46.255967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0798e8-b7a3-4bd5-ba2f-01e45d7a2ab4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:46.296270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:46.296270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:46.296270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:46.296270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:46.305541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:46.308835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:10:46.325516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:46.326621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:46.327729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:46.329550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 607/1217] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:46.335646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:46.458337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c43fd7-8fe9-440d-8efb-e6b9d24409f1 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:46.484859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:46.499481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661d338-e915-453c-9c54-46e93989afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:46.500152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d338-e915-453c-9c54-46e93989afca None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:46.500428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d338-e915-453c-9c54-46e93989afca None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:46.500697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d338-e915-453c-9c54-46e93989afca None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:46.501494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d338-e915-453c-9c54-46e93989afca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:46.501919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d338-e915-453c-9c54-46e93989afca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:46.503963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661d338-e915-453c-9c54-46e93989afca None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:46.522545 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 611/1218] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:46.524774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:46.633894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab357172-34d9-4eec-8064-cc4b0f215835 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:46.664382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:46.671098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:46.671717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:46.671992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:46.672264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:46.672998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=a86ad86f6b9d40b0be18eb23c4e8c08b) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:46.673309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:46.674804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536de63-260c-4394-9229-bde0882a4c83 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:46.692434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 608/1219] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:10:46 2022] GET /identity/v3/role_assignments?user.id=a86ad86f6b9d40b0be18eb23c4e8c08b&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:48.690603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc8dd-f7e1-4b74-b9ed-e98d550c1262 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:48.691183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc8dd-f7e1-4b74-b9ed-e98d550c1262 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:48.691282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cc8dd-f7e1-4b74-b9ed-e98d550c1262 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:48.692772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 612/1220] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:10:48.698718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:48.699161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:48.699264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:48.718958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:10:48.720143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:10:48.798386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 609/1221] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:10:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:10:49.100339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cc8dd-f7e1-4b74-b9ed-e98d550c1262 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:49.214747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cc8dd-f7e1-4b74-b9ed-e98d550c1262 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:49.250540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:49.251319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:49.251694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:49.252039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:49.264612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:10:49.270362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:49.271565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:49.272496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 613/1222] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:49.278383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:49.391182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032a4dc-76db-4bc9-b1a7-eb6405fdbb0d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:49.418084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:49.430671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:49.431433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:49.431769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:49.432114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:49.432830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:49.433252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:49.435215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:49.446682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 610/1223] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:49.452811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:49.501719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:49.565384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb58be7-44eb-48de-a0fe-11b450f573d6 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:49.602280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:49.602948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:49.603227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:49.603496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:49.614311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:49.615763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:49.630907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:49.632767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:49.634624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:49.634624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:49.634624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:49.634624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 614/1224] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:49.639112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:49.750365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00b572-5409-440a-b861-5963facfb6ff None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:49.793608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:49.794078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:49.794366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:49.794793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:49.795696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:49.796042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:49.797674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:49.810731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 611/1225] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:49.816595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:49.919741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:49.928059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a422c-7196-4c08-98a0-f3e9258bd55b None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:49.968099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:49.968726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:49.969011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:49.969280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:49.977253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:49.979038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:10:49.993019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:49.994292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:49.995400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 615/1226] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:50.000714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.051615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:50.106506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680811c-304f-4840-a4c1-7060b7880a36 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:50.142012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:50.142614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:50.142894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:50.143158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:50.143908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:50.144211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:50.145719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:50.164472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 612/1227] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:10:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:10:50.170609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.285440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb8065-223b-442c-8e00-0416be6fc753 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:50.322694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:50.323432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:50.324006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:50.324143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:50.335094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:50.336585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:50.353127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:50.354396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:50.355323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:50.355323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:50.355323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:50.355323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 616/1228] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:10:50.360791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.474217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ed691-bb3c-44cc-9937-06feed9c3e9f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:50.476639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:50.510374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:50.511084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:50.511360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:50.511627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:50.512303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:50.512602 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:50.513995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:50.526646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 613/1229] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:50.534383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.545876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:50.649829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487fc9e-6b46-4635-ad4b-0abaafac1118 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:50.689082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:50.689747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:50.690029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:50.690300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:50.696996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:50.698484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:10:50.710668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:50.711880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:50.712927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 617/1230] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:10:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:10:50.717921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.840066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef8a7-9e99-4657-a836-0a14e2471959 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:50.876531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:50.877168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:50.877469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:50.877736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:50.878525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:50.878824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:50.880247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d4cec-e31d-4722-9bb4-031e5ac72797 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:50.892637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 614/1231] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:10:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:10:50.899102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:50.981877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:51.023218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087f172-c100-45dc-adec-990d7020c908 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:51.058188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:51.059077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:51.059327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:51.059628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/a86ad86f6b9d40b0be18eb23c4e8c08b/roles/7fc703ebcef24ae6ae70c6965c85538d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:51.076655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=a86ad86f6b9d40b0be18eb23c4e8c08b, role_id=7fc703ebcef24ae6ae70c6965c85538d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:51.078521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9035005-78d3-431d-be5d-479f902a562e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:51.092638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 618/1232] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:10:50 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/a86ad86f6b9d40b0be18eb23c4e8c08b/roles/7fc703ebcef24ae6ae70c6965c85538d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:10:53.005596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5dfc-cd2d-4453-a564-6bad326df80a None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:53.006378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5dfc-cd2d-4453-a564-6bad326df80a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:53.006378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea5dfc-cd2d-4453-a564-6bad326df80a None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:53.007499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 615/1233] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:10:53.012919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:53.013438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:53.013555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:53.033453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:10:53.035079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:10:53.111293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 619/1234] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:10:53.386309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5dfc-cd2d-4453-a564-6bad326df80a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:53.414096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:53.497569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea5dfc-cd2d-4453-a564-6bad326df80a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:53.535408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:53.536039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:53.536313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:53.536579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:53.546956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:10:53.551753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:53.552794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:53.553693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 616/1235] 10.222.0.61 () {56 vars in 1102 bytes} [Sat Aug 27 02:10:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:53.559465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:53.604859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:53.664318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a823738-a512-482e-a8f9-1fdd51ded064 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:53.700451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:53.701052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:53.701328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:53.701624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:53.702292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] RBAC: Adding query filter params (name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:53.702588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:53.703940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:53.713596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 620/1236] 10.222.0.61 () {56 vars in 1103 bytes} [Sat Aug 27 02:10:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:53.719931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:53.812466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:53.832281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d2c4-8cd3-46a9-b195-d1040701068c None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:53.867742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:53.868330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:53.868630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:53.868938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:53.881219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:53.882703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:53.898403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:53.899893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:53.900818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:53.900818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:53.900818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:53.900818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 617/1237] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:53.906334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.017589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ef876-78f1-4d91-a0d2-86f2da76ad81 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:54.028004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:54.055637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:54.056262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:54.056537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:54.056808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:54.057669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:54.057990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:54.059777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:54.074095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 621/1238] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:54.080291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.190696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a306-615b-4582-8a76-390fd509bfb4 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:54.226521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:54.227169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:54.227465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:54.227738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:54.230991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:54.237109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:54.238710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:10:54.250214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:54.251266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:54.252304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 618/1239] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:54.257472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.377005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2a00e-ca85-43e5-9287-5862d009c555 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:54.415564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:54.416283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:54.416568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:54.416863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:54.417626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:54.417928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:54.419780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:54.444221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 622/1240] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:10:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:54.446463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.556680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65596d4-9c82-45ed-b5f4-0672772d231e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:54.593891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:54.594538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:54.594842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:54.595125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:54.659289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:54.668411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:54.669964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:54.772970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 619/1241] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:10:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:10:54.779173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.813631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:54.892627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035a527-767d-4904-a1da-df51d864ccd7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:54.931931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:54.932571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:54.932893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:54.933137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:54.944244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:54.946052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:54.961961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:54.963146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:54.964280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:54.964280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:54.964280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:54.969074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:54.969470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 623/1242] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:55.064694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:55.070803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8bc1-d7f8-4e80-b228-22a700f4b260 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:55.108266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:55.109693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:55.109989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:55.110294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:55.111074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:55.111411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:55.112811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:55.125161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 620/1243] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:55.131217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:55.219665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:55.242865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc2e0f-e71d-4403-9960-13c5ff324a95 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:55.281568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:55.282224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:55.282548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:55.282837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:55.291661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:55.293633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:10:55.307398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:55.308424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:55.309766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 624/1244] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:55.316162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:55.430969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa64d7b-7747-4db3-b900-fedeb39d0182 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:55.471994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:55.472838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:55.473255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:55.473696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:55.474514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:55.474916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:55.476645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9df70-073d-457f-8873-2709efa53d22 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:55.492657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 621/1245] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:55.500212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:55.616506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73919578-7a0d-4887-8dcd-e5da1b96c1fc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:55.651135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:55.651793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:55.652160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:55.652395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:55.653217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] RBAC: Adding query filter params (role.id=7fc703ebcef24ae6ae70c6965c85538d, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=a86ad86f6b9d40b0be18eb23c4e8c08b) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:55.653595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:55.655129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eefa30d-9877-43d6-a130-82ba74b261a1 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:55.661738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 625/1246] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:10:55 2022] GET /identity/v3/role_assignments?user.id=a86ad86f6b9d40b0be18eb23c4e8c08b&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=7fc703ebcef24ae6ae70c6965c85538d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:57.667401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526d88-d583-4d56-96db-45e61bbe4fb3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:57.667941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526d88-d583-4d56-96db-45e61bbe4fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:57.668164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71526d88-d583-4d56-96db-45e61bbe4fb3 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:57.669637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 622/1247] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:10:57.675522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:57.676030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:57.676030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:57.682493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:57.695690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:10:57.696933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:10:57.773774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 626/1248] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:10:58.068696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71526d88-d583-4d56-96db-45e61bbe4fb3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:58.088725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:58.183529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71526d88-d583-4d56-96db-45e61bbe4fb3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:58.221880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:58.222518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:58.222801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:58.223068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:58.233791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:10:58.238626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:58.239799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:58.240921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 623/1249] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:58.246636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:58.358521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9060-11cf-4811-a4ce-de24bf075c97 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:58.393283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:58.401032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:58.401765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:58.402054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:58.402327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:58.403018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:58.403320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:58.405013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:58.415024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 627/1250] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:58.422170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:58.509080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:58.534753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74cf73-0420-45dd-8825-9eb70817315f None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:58.571563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:58.572212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:58.572497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:58.572773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:58.584595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:58.586100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:58.601745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:58.602943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:58.603878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:58.603878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:58.603878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:58.603878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 624/1251] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:58.609148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:58.723757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9429130-2062-4bfa-8e74-804ebb29fc0a None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:58.763850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:58.764976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:58.765346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:58.765744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:58.766523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:58.766847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:58.768602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:58.784937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 628/1252] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:58.791244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:58.908647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d00115-f786-4ccd-a49d-43c94b494852 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:58.939460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:58.948593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:58.949237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:58.949572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:58.949812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:58.959019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:58.962266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:10:58.976539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:58.977819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:10:58.978979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 625/1253] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:58.986753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:59.054057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:59.107241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e000d9-f507-45ae-a278-a15e2cf8c937 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:59.155195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:59.155920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:59.156270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:59.156540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:59.157511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:59.157816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:59.159741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:59.182254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 629/1254] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:10:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:59.188501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:59.312241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f2213-3d5b-4155-8d3f-7a5f82e5486d None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:59.358110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:59.358800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:59.359090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:59.359362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:59.432951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:59.448953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:59.450493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:59.569874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 626/1255] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:10:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:10:59.576405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:59.693323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad46b-e42b-4c9c-ab65-1faf2bd4197c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:59.710145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:59.736452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:59.737149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:59.737487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:59.738000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:59.750012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:59.751845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:10:59.770754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:10:59.772190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:10:59.773365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:10:59.773365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:10:59.773365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:10:59.773365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 630/1256] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:10:59.780354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:10:59.881299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:10:59.894019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5516395-e7da-49aa-a69f-71e68bf23eab None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:10:59.939794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:10:59.940821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:10:59.941193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:10:59.941574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:10:59.942580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:10:59.943053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:10:59.945316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:10:59.964051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 627/1257] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:10:59.970471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:00.100195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9c509-1c5e-4407-8ad2-16357271fff7 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:00.141131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:00.141853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:00.142131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:00.142421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:00.150756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:00.152435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:11:00.165496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:00.166603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:00.167636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 631/1258] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:00.173524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:00.298268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65796b7c-5935-4940-aa36-305592aab293 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:00.341502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:00.342413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:00.342862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:00.343134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:00.343954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:00.344301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:00.345937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f402f-ccf0-4dd7-9259-1448338b4287 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:00.359077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 628/1259] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:11:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:00.365162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:00.393819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:00.474998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4fe0d-694b-4d77-a60a-3202ced85a22 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:00.512204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:00.512899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:00.513170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:00.513469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:00.514207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=a86ad86f6b9d40b0be18eb23c4e8c08b) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:00.514503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:00.515942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e223e-9eb2-43a5-9bfd-ff4504154801 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:00.524720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 632/1260] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:11:00 2022] GET /identity/v3/role_assignments?user.id=a86ad86f6b9d40b0be18eb23c4e8c08b&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:11:02.526422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c78a-10bb-4a82-ba6b-f0eaf67c8108 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:02.526987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c78a-10bb-4a82-ba6b-f0eaf67c8108 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:02.526987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c78a-10bb-4a82-ba6b-f0eaf67c8108 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:02.528325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 629/1261] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:02.533635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:02.534157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:02.534333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:02.553339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:02.554845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:02.628297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 633/1262] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:02.890909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c78a-10bb-4a82-ba6b-f0eaf67c8108 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:02.902604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.005204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c78a-10bb-4a82-ba6b-f0eaf67c8108 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.040284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.040912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.041189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.041471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.052286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:11:03.057109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:03.058300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:11:03.059409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:03.061599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 630/1263] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:03.064554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:03.084786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.171996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60ce5a-bd83-45fc-a886-b98a7d16b40b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.208254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.208869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.209149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.209427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.210114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:03.210415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:03.211811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:03.221131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 634/1264] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:03.227443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:03.297491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.333921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc56e2-de6d-47f4-9b96-58ce0889d88e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.370665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.371313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.371594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.371866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.382859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:03.384387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:11:03.400711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:03.401949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:11:03.402887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:11:03.402887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:03.402887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:03.402887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 631/1265] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:03.408526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:03.496859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.518084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeed12e-e7a8-4cec-aea3-7b9c124ad5ed None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.555903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.556586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.556785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.557053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.557739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:03.558038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:03.559395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:03.573877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 635/1266] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:03.579864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:03.682317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b9bd-12fa-4e25-9abe-027421598e0b None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.702636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.718551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.719131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.719412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.719682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.728560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:03.730050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:11:03.741432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:03.742538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:03.743503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 632/1267] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:03.748725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:03.894254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647060-eb28-4c09-af8c-06a4d1ef404e None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:03.933131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:03.933774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:03.934052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:03.934324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:03.935061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:03.935360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:03.936804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:03.947151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:03.956154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 636/1268] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:03.962058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:04.078747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abf3d7-5447-408b-bc07-52c73a6ae1cd None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:04.112586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:04.113202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:04.113505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:04.113772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:04.124319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:04.125789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:11:04.139674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:04.140675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:11:04.141589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:11:04.141589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:04.141589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:04.141589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 633/1269] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:04.146943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:04.256846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0b06-ea05-4883-a64c-38c203162a59 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:04.304877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:04.305503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:04.305778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:04.306043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:04.306685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:04.306983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:04.308361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:04.320721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 637/1270] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:04.326916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:04.360187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:04.435452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bff2-f236-4589-8cb8-c419a253d249 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:04.472436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:04.473066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:04.473341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:04.473643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:04.480494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:04.482002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:11:04.493311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:04.494414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:04.495386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 634/1271] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:11:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:04.500461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:04.564313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:04.609012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9626b1-6d73-4bcb-bcc7-df89f45e0498 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:04.646018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:04.646519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:04.646792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:04.647057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:04.647735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:04.648036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:04.649811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc089109-1b44-426e-be0f-d840fcd77a15 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:04.662522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 638/1272] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:11:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:04.668876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:04.771615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:04.782161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482db89-93fc-450b-b471-cc8ae076e549 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:04.824489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:04.825179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:04.825493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:04.825774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] PATH_INFO: `/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/a86ad86f6b9d40b0be18eb23c4e8c08b/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:04.827949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] RBAC: Authorizing `identity:create_grant(project_id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user_id=a86ad86f6b9d40b0be18eb23c4e8c08b, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:04.829470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34838b2a-1b87-4b7e-87e0-2e8e4d95ea5a None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:04.844869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 635/1273] 10.222.0.61 () {58 vars in 1439 bytes} [Sat Aug 27 02:11:04 2022] PUT /identity/v3/projects/eb0eac5d7e6d4e069fda9ac4cb8c2c98/users/a86ad86f6b9d40b0be18eb23c4e8c08b/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:11:06.722176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9c7d-bd20-409a-a555-d7df1a967909 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:06.722736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9c7d-bd20-409a-a555-d7df1a967909 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:06.722736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed9c7d-bd20-409a-a555-d7df1a967909 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:06.724055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 639/1274] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:06.729378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:06.729841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:06.729933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:06.749442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:06.750627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:06.822746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 636/1275] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:07.084362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9c7d-bd20-409a-a555-d7df1a967909 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.189441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed9c7d-bd20-409a-a555-d7df1a967909 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:07.208934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:07.226217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:07.226861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:07.227131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:07.227396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:07.237709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 27 02:11:07.242397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:07.243474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:07.244360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 640/1276] 10.222.0.61 () {56 vars in 1096 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:07.249686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.332758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:07.352545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a821e69-cfc1-4241-92e4-5eb9bff49c7f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:07.388154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:07.388740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:07.389032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:07.389293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:07.389986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:07.390282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:07.391641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:07.400411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 637/1277] 10.222.0.61 () {56 vars in 1099 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:07.406588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.510977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8422-3560-4b78-9e1b-c3e2d7061723 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:07.547667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:07.548295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:07.548566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:07.548832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:07.559761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:07.561229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:11:07.576927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:07.578097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:11:07.579251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:11:07.579251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:07.579251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:07.579251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 641/1278] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:07.586330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.734612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc8cc-e493-4460-b0a0-bca39026ee70 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:07.783356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:07.784179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:07.784499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:07.784915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:07.785636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:07.785943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:07.787328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:07.801754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 638/1279] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:07.807859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.839709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:07.912832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f97081-e834-4fab-8812-9d6ad1ad3360 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:07.949226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:07.949888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:07.950164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:07.950435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:07.958637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:07.960092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 27 02:11:07.971768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:07.972970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 27 02:11:07.974274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:07.977791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 642/1280] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:07.978840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:07.982778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:08.076633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77442ca-cec4-4085-bf42-a8ce97ba30b5 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:08.120436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:08.121047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:08.121318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:08.121614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:08.122347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:08.122646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:08.124070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:08.141927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 639/1281] 10.222.0.61 () {56 vars in 1143 bytes} [Sat Aug 27 02:11:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:08.148141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:08.245223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:08.256392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d235b6-0427-4f86-bea2-d6073972c8f5 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:08.290626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:08.291232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:08.291512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:08.291783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:08.367418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:08.368786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:08.462687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:08.473652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 643/1282] 10.222.0.61 () {58 vars in 1282 bytes} [Sat Aug 27 02:11:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 27 02:11:08.479714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:08.547559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:08.594278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7cab3-225c-40dc-860c-acf0f482f45e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:08.632451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:08.632980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:08.633259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:08.633556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:08.643960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:08.645426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 27 02:11:08.660149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:08.661286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 27 02:11:08.662405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 27 02:11:08.662405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 27 02:11:08.662405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:08.662405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 640/1283] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:11:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:08.668703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:08.780760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fc78d-0182-49ca-908c-5376af83b411 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:08.818131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:08.818836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:08.818996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:08.819253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:08.819893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:08.820192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:08.821607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:08.834337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 644/1284] 10.222.0.61 () {56 vars in 1109 bytes} [Sat Aug 27 02:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:08.840669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:08.950153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a4fb9-24e8-4df5-8983-21d688ca4699 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:08.965687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:08.988397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:08.989123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:08.989422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:08.989700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:08.997285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:08.998774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 27 02:11:09.011675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:09.012718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: ERROR keystone.server.flask.application Aug 27 02:11:09.013850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 641/1285] 10.222.0.61 () {56 vars in 1111 bytes} [Sat Aug 27 02:11:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:09.019010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:09.073895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:09.128376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8994b7a-a334-42aa-9b99-0a1471e7f391 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:09.166240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:09.166847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:09.167126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:09.167396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:09.168086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:09.168382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:09.169853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8075cc-a4d4-4172-b321-4ce62d516dc7 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:09.182744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 645/1286] 10.222.0.61 () {56 vars in 1148 bytes} [Sat Aug 27 02:11:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:09.189270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:09.303718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb8d9e-cb04-4987-8351-c2ec43793479 None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:09.337777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76488612-16f5-495a-a271-80145aab6619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:09.338379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488612-16f5-495a-a271-80145aab6619 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:09.338657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488612-16f5-495a-a271-80145aab6619 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:09.338925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76488612-16f5-495a-a271-80145aab6619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:09.339658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76488612-16f5-495a-a271-80145aab6619 None admin] RBAC: Adding query filter params (role.id=5e401bf60fb64af593e7f8832f68ae16, scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98, user.id=a86ad86f6b9d40b0be18eb23c4e8c08b) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:09.339964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76488612-16f5-495a-a271-80145aab6619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:09.341376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76488612-16f5-495a-a271-80145aab6619 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:09.347279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 642/1287] 10.222.0.61 () {56 vars in 1374 bytes} [Sat Aug 27 02:11:09 2022] GET /identity/v3/role_assignments?user.id=a86ad86f6b9d40b0be18eb23c4e8c08b&scope.project.id=eb0eac5d7e6d4e069fda9ac4cb8c2c98&role.id=5e401bf60fb64af593e7f8832f68ae16 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:11.256671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05bdac-5c58-4aac-a2a2-2ccfa7996f41 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:11.257259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05bdac-5c58-4aac-a2a2-2ccfa7996f41 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:11.257259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05bdac-5c58-4aac-a2a2-2ccfa7996f41 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:11.258567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 646/1288] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:11.263913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:11.264326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:11.264434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:11.284809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:11.286115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:11.323922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:11.364702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 643/1289] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:11.629630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05bdac-5c58-4aac-a2a2-2ccfa7996f41 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:11.740817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05bdac-5c58-4aac-a2a2-2ccfa7996f41 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:11.752157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:11.778398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:11.779033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:11.779307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:11.779587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:11.780172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:11.781573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:11.791019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:11.792273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:11.793135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:11.797293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 647/1290] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:11:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:11.798395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:11.917193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b73d82-7459-48a7-9df5-9b8c5c4dbe92 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:11.959479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:11.960089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:11.960370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:11.960639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:11.961277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:11.961611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:11.963813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af163f14-7606-498e-844a-25f5cc732e0f None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:11.969147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 644/1291] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Aug 27 02:11:11 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:11.975223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:12.078055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ebcd9-9fec-4733-8eb9-ab3756371f39 None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:12.112723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:12.113318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:12.113606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:12.113897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] PATH_INFO: `/v3/services` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:12.114523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:12.114819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:12.116191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb81d4-5f22-467e-9a5c-f3a36443bf2f None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:12.121078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 648/1292] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Aug 27 02:11:11 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:14.058683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f80e-1795-466f-bfde-a6d331ab16c4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:14.059280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f80e-1795-466f-bfde-a6d331ab16c4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:14.059280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9f80e-1795-466f-bfde-a6d331ab16c4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:14.060561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 645/1293] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:14.066262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa8d3-458a-4542-adf9-b6fee9aadb03 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:14.066689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa8d3-458a-4542-adf9-b6fee9aadb03 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:14.066807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9aa8d3-458a-4542-adf9-b6fee9aadb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:14.086070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-eb9aa8d3-458a-4542-adf9-b6fee9aadb03 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:14.087263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-eb9aa8d3-458a-4542-adf9-b6fee9aadb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:14.123457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:14.163134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 649/1294] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:14.429250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f80e-1795-466f-bfde-a6d331ab16c4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:14.464910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:14.538381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9f80e-1795-466f-bfde-a6d331ab16c4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:14.574994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:14.575595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:14.575873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:14.576146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:14.576798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:14.578205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6486ad-ffe2-4223-bcde-c958ca26eb51 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:14.595056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 646/1295] 10.222.0.61 () {60 vars in 1141 bytes} [Sat Aug 27 02:11:14 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:11:16.545804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dce8-3bbc-4955-899d-651c09712643 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:16.546429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dce8-3bbc-4955-899d-651c09712643 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:16.546429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1dce8-3bbc-4955-899d-651c09712643 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:16.547708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 650/1296] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:16.553143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:16.553647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:16.553740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:16.572538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:16.573804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:16.654483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 647/1297] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:16 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:16.922592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1dce8-3bbc-4955-899d-651c09712643 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:17.050015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1dce8-3bbc-4955-899d-651c09712643 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:17.089296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:17.089964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:17.090243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:17.090792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:17.091107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:17.092504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:17.101788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:17.102965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:17.103951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 651/1298] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:11:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 27 02:11:17.109045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:17.127731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:17.210534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719898b-9610-427d-a6ad-79be5b6d8803 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:17.246074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:17.246682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:17.246962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:17.247236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:17.247869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:17.248169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:17.249584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:17.255009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 648/1299] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Aug 27 02:11:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:17.261221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:17.294442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:17.378942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc741b28-c24c-48af-bd42-729cd7cfd12c None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:17.422757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:17.423361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:17.423638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:17.423936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:17.424695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] RBAC: Adding query filter params (interface=public, service_id=11f0f7189db646cba300dd25d69b04f8, region_id=RegionOne) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:17.425002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:17.426404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05f523-4dea-45c4-ae03-32b22c6a0ffd None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:17.432004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 652/1300] 10.222.0.61 () {56 vars in 1251 bytes} [Sat Aug 27 02:11:17 2022] GET /identity/v3/endpoints?service_id=11f0f7189db646cba300dd25d69b04f8&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:17.437981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:17.524512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:17.543224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692c90f-8228-4e2b-8c3e-b131e425b25e None admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:17.577079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:17.577783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:17.577984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:17.578262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:17.578866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:17.580438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0354a-0702-49a2-8fb8-e85a7c6f0386 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:17.587290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 649/1301] 10.222.0.61 () {56 vars in 1087 bytes} [Sat Aug 27 02:11:17 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:11:19.500888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f067d9-2373-4ffe-a84c-2ce2fe15bcb6 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:19.501480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f067d9-2373-4ffe-a84c-2ce2fe15bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:19.501480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f067d9-2373-4ffe-a84c-2ce2fe15bcb6 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:19.502971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 653/1302] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:11:19.508485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489b391-d968-41cc-8c7f-87119124112d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:19.508925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489b391-d968-41cc-8c7f-87119124112d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:19.509017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489b391-d968-41cc-8c7f-87119124112d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:19.528766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b489b391-d968-41cc-8c7f-87119124112d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:11:19.530067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b489b391-d968-41cc-8c7f-87119124112d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:11:19.602176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 650/1303] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:11:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 27 02:11:19.869461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f067d9-2373-4ffe-a84c-2ce2fe15bcb6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:19.971154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:19.978384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f067d9-2373-4ffe-a84c-2ce2fe15bcb6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:20.012483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:20.013109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:20.013384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:20.013684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:20.014270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:20.015631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 27 02:11:20.024761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 27 02:11:20.025980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.get_or_create( Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application with Lock( Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self._enter() Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application return self.creator() Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application created_value = creator( Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: ERROR keystone.server.flask.application Aug 27 02:11:20.026891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 654/1304] 10.222.0.61 () {56 vars in 1117 bytes} [Sat Aug 27 02:11:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 27 02:11:20.032295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489b391-d968-41cc-8c7f-87119124112d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:20.113119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:20.136926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489b391-d968-41cc-8c7f-87119124112d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:20.175169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:20.175777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:20.176055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:20.176321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] PATH_INFO: `/v3/services` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:20.176956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:11:20.177258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:20.178671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faaa73c-108b-4a6c-a759-b47ecebd8339 None admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:20.187196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 651/1305] 10.222.0.61 () {56 vars in 1116 bytes} [Sat Aug 27 02:11:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:11:20.197947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:11:20.304171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609b34-1c9c-4727-b179-2ea03b50f7cc None admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:11:20.338517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:11:20.339134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:11:20.339390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:11:20.339668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:11:20.340362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:11:20.341755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d40628-a07e-416c-8dab-d990df3af788 None admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:11:20.361642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 655/1306] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:11:20 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:11:30.180947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=30 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:11:30.357590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:27.414700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63af9e-8fe4-489f-b24b-61388e5b55c3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:27.415915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63af9e-8fe4-489f-b24b-61388e5b55c3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:27.416455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63af9e-8fe4-489f-b24b-61388e5b55c3 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:27.418760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 652/1307] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:27.424080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221f0a-9505-4f18-bceb-5ad87ff7df06 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:27.425106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221f0a-9505-4f18-bceb-5ad87ff7df06 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:27.425687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221f0a-9505-4f18-bceb-5ad87ff7df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:27.611626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3a221f0a-9505-4f18-bceb-5ad87ff7df06 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:27.612968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3a221f0a-9505-4f18-bceb-5ad87ff7df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:27.746065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 656/1308] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:28.040698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:28.041560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:28.042133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:28.044833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 653/1309] 10.222.0.61 () {54 vars in 965 bytes} [Sat Aug 27 02:12:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:28.051602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277588e-6b88-4503-b79f-a4003925ca10 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:28.051848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277588e-6b88-4503-b79f-a4003925ca10 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:28.052157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277588e-6b88-4503-b79f-a4003925ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:28.152691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8277588e-6b88-4503-b79f-a4003925ca10 None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:28.153976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8277588e-6b88-4503-b79f-a4003925ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:28.176558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:28.237442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 657/1310] 10.222.0.61 () {58 vars in 1062 bytes} [Sat Aug 27 02:12:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:28.246907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:28.249886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:28.402945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae73af8-10af-4be0-ba55-91e1a664debe None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:28.485606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:28.487168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:28.487648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:28.488116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:28.490218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:28.553367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:28.614888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:28.616293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76d8c-39e1-47f0-9612-bd8604206feb service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:28.645440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 654/1311] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:30.916344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:30.917042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:30.917042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:30.920348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 658/1312] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:30.926157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019fa8d-d5fe-46d5-bc78-a66fc3de2feb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:30.926604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019fa8d-d5fe-46d5-bc78-a66fc3de2feb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:30.926691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019fa8d-d5fe-46d5-bc78-a66fc3de2feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:31.035374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7019fa8d-d5fe-46d5-bc78-a66fc3de2feb None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:31.037040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7019fa8d-d5fe-46d5-bc78-a66fc3de2feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:31.139368 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 655/1313] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:31.416523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:31.418139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:31.550349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993126-d6d1-4c71-a956-09328b46d9f8 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:31.641946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:31.644986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:31.645909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:31.646245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:31.646652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:31.648875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:31.774111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:31.775596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7341ff7-6b46-4838-91d0-3e4bd712ec8a service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:31.802704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 659/1314] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:34.065112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:34.065732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:34.065732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:34.067052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 656/1315] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:34.073192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e42c-6a32-4192-9c6d-779badd1d06c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:34.073667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e42c-6a32-4192-9c6d-779badd1d06c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:34.073769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd0e42c-6a32-4192-9c6d-779badd1d06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:34.149134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4bd0e42c-6a32-4192-9c6d-779badd1d06c None None] MFA Rules not processed for user `c26b8fa36ae14513bd7429e75abc8dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:34.150771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4bd0e42c-6a32-4192-9c6d-779badd1d06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:34.204386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:34.252538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 660/1316] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:34.534233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:34.536068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:34.549557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:34.662066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c659e9-8873-4e3e-867c-8acb7bc7cfa5 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:34.752341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:34.752969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:34.753242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:34.753546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:34.755151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:34.831195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:34.884982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:34.886484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8653f66-d9fb-453c-87c7-884c5c3fa597 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:34.913718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 657/1317] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:37.421944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830236-126e-47ad-aa69-731f9667c7ef None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:37.422605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830236-126e-47ad-aa69-731f9667c7ef None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:37.422605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830236-126e-47ad-aa69-731f9667c7ef None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:37.423851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 661/1318] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:37.430305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a79d2-e7f7-494c-9627-b85c916d82f5 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:37.431392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a79d2-e7f7-494c-9627-b85c916d82f5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:37.431392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a79d2-e7f7-494c-9627-b85c916d82f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:37.502053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e77a79d2-e7f7-494c-9627-b85c916d82f5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:37.503282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e77a79d2-e7f7-494c-9627-b85c916d82f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:37.616088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 658/1319] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:37.921297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:37.921635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:37.921934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:37.926259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 662/1320] 10.222.0.61 () {54 vars in 965 bytes} [Sat Aug 27 02:12:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:37.932276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3da0-400b-4939-9a9b-5773140eb05e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:37.932576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3da0-400b-4939-9a9b-5773140eb05e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:37.932857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa3da0-400b-4939-9a9b-5773140eb05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:37.961829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:38.026596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a2aa3da0-400b-4939-9a9b-5773140eb05e None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:38.028042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a2aa3da0-400b-4939-9a9b-5773140eb05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:38.113955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 659/1321] 10.222.0.61 () {58 vars in 1062 bytes} [Sat Aug 27 02:12:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:38.123262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:38.125105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:38.257511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7647ec-a399-4552-b586-b4afabb9ed58 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:38.338192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:38.338801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:38.339078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:38.339376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:38.340998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:38.348383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:38.455624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:38.457060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49e576-516d-40d6-9332-eddbb9d5e5da service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:38.478429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 663/1322] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:41.579040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810297-7457-4161-a04d-9ed7f608163b None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:41.579785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810297-7457-4161-a04d-9ed7f608163b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:41.579785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87810297-7457-4161-a04d-9ed7f608163b None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:41.580918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 660/1323] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:41.586444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d33-8b5c-43de-ae44-64af1ff97efb None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:41.586922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d33-8b5c-43de-ae44-64af1ff97efb None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:41.587090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8d33-8b5c-43de-ae44-64af1ff97efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:41.659796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-adbe8d33-8b5c-43de-ae44-64af1ff97efb None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:41.661322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-adbe8d33-8b5c-43de-ae44-64af1ff97efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:41.724406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:41.771745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 664/1324] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:12:42.066456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810297-7457-4161-a04d-9ed7f608163b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:42.067979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-87810297-7457-4161-a04d-9ed7f608163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:42.187358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87810297-7457-4161-a04d-9ed7f608163b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:42.201518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:42.279868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:42.280377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:42.280701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:42.280966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:42.282633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:42.402691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:42.404140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b70cc31-b595-4647-aeee-11eb5d393262 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:42.426840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 661/1325] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:44.458559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:44.459106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:44.459106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:44.460471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 665/1326] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:44.466944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3809-e870-4a40-bb6a-bdfb07af0e01 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:44.467523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3809-e870-4a40-bb6a-bdfb07af0e01 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:44.467523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c3809-e870-4a40-bb6a-bdfb07af0e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:44.538197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:44.558518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-794c3809-e870-4a40-bb6a-bdfb07af0e01 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:44.559775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-794c3809-e870-4a40-bb6a-bdfb07af0e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:44.684522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 662/1327] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:45.006956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:45.008481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:45.157044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d011e-c393-4c4e-8a88-2ae31f9b36cb None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:45.251456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:45.252354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:45.260262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:45.260262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:45.260262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:45.279520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:45.398870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:45.401343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417f50a-719c-4f28-b163-66d082cae1e9 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:45.423498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 666/1328] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:47.609202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:47.609876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:47.609876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:47.611196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 663/1329] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:47.617543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e89bc-e820-4c06-8954-175b4ac11dba None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:47.618128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e89bc-e820-4c06-8954-175b4ac11dba None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:47.619039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e89bc-e820-4c06-8954-175b4ac11dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:47.715947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0d6e89bc-e820-4c06-8954-175b4ac11dba None None] MFA Rules not processed for user `c26b8fa36ae14513bd7429e75abc8dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:47.717354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0d6e89bc-e820-4c06-8954-175b4ac11dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:47.825610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:47.867907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 667/1330] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:48.170907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:48.172598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:48.303245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe32df4-94f4-4111-9fb9-8b2cc71896df None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:48.330248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:48.404527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:48.405247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:48.405796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:48.406104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:48.408719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:48.550477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:48.551926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201a605-0eed-409f-a693-c970bbcced66 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:48.576033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 664/1331] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:50.815122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:50.815735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:50.815735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:50.817115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 668/1332] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:12:50.823029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48456-1f42-40ec-9703-5b76da3cd721 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:50.823478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48456-1f42-40ec-9703-5b76da3cd721 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:50.823569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd48456-1f42-40ec-9703-5b76da3cd721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:50.919780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:50.923625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5cd48456-1f42-40ec-9703-5b76da3cd721 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:50.925978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5cd48456-1f42-40ec-9703-5b76da3cd721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:51.069130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 665/1333] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:51.370588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:51.372121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:51.487858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62b5d7-baa3-4a8e-b822-afed889b1d3c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:51.575186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:51.575798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:51.576070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:51.576336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:51.578049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:51.611568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:51.713477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:51.714854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62001e3-334d-417e-ad44-913b9d74b25b service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:51.734122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 669/1334] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:53.767734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:53.768316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:53.768316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:53.770174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 666/1335] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 27 02:12:53.778564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881093-feed-431a-98b6-d933b6f734ae None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:53.779057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881093-feed-431a-98b6-d933b6f734ae None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:53.779155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24881093-feed-431a-98b6-d933b6f734ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:53.860796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-24881093-feed-431a-98b6-d933b6f734ae None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:53.862127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-24881093-feed-431a-98b6-d933b6f734ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:53.953176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:53.980438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 670/1336] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:54.264918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:54.269179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:54.392554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90136af5-06c1-46b1-b8b0-95a3a3550f38 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:54.433842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:54.498672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:54.499293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:54.499571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:54.499830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:54.503047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:54.632142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:54.634493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e33e4-6f1d-4162-9177-2b01446050b4 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:54.670122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 667/1337] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:12:57.054908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:57.055577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:57.055577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:57.056905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 671/1338] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:12:57.062705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b4b6-75d0-4bfe-ac35-f37b4658ea1d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:57.063172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b4b6-75d0-4bfe-ac35-f37b4658ea1d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:57.063317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b4b6-75d0-4bfe-ac35-f37b4658ea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:57.138572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1608b4b6-75d0-4bfe-ac35-f37b4658ea1d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:12:57.139793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1608b4b6-75d0-4bfe-ac35-f37b4658ea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:57.148568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:57.247143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 668/1339] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:12:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:12:57.526057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:12:57.527753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:57.648985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779612b-23f2-43f1-94b7-e9eda40904e7 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:12:57.739434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:12:57.740146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:12:57.740470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:12:57.740821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:12:57.742996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:12:57.794350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:12:57.884356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:12:57.885846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d9885-7203-4f0b-a17e-ecef2060e3f5 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:12:57.905124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 672/1340] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:12:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:02.307981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:02.308588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:02.308588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:02.310206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 669/1341] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:02.316095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce4da-d38c-4259-9fb1-e88b15b81737 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:02.316604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce4da-d38c-4259-9fb1-e88b15b81737 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:02.316706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcce4da-d38c-4259-9fb1-e88b15b81737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:02.385816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-adcce4da-d38c-4259-9fb1-e88b15b81737 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:02.387014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-adcce4da-d38c-4259-9fb1-e88b15b81737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:02.477222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:02.491845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 673/1342] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:02.774121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:02.776912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:02.897669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379deeb-ccfc-4fd8-8651-bf1867b34a85 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:02.939926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:02.981466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:02.982387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:02.982661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:02.982953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:02.984743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:03.100337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:03.102017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997625a9-efe8-44d8-b5e1-6c3ea737bc46 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:03.121308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 670/1343] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:05.698133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:05.698697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:05.698697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:05.700017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 674/1344] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:05.705647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84438-5347-443f-a6b6-a6e06ee5a4a6 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:05.706182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84438-5347-443f-a6b6-a6e06ee5a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:05.706182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b84438-5347-443f-a6b6-a6e06ee5a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:05.778038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-03b84438-5347-443f-a6b6-a6e06ee5a4a6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:05.779266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-03b84438-5347-443f-a6b6-a6e06ee5a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:05.798634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:05.906297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 671/1345] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:06.184232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:06.185933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:06.304358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb59784-4c7d-48a0-8804-77bbf7c6b33a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:06.394594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:06.395200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:06.395471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:06.395734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:06.397701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:06.449653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:06.523135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:06.524621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a34d5-516c-4125-a53d-ee36ab413bd8 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:06.548889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 675/1346] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:13:10.862162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:10.862858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:10.862858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:10.864066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 672/1347] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:10.869989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74881074-3a08-468e-80af-631af046043c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:10.870512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74881074-3a08-468e-80af-631af046043c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:10.870512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74881074-3a08-468e-80af-631af046043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:10.943465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-74881074-3a08-468e-80af-631af046043c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:10.944822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-74881074-3a08-468e-80af-631af046043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:11.065353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:11.075949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 676/1348] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:11.358376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:11.360017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:11.491531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39efeb-d783-4e24-b775-9b6fac99081b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:11.540957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:11.569340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:11.569977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:11.570255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:11.570509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:11.572140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:11.686021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:11.687364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02873069-5da0-48c9-824c-0b9d67133f28 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:11.705671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 673/1349] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:16.682045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f4bd-9e2f-4535-9db8-6987dff5f5c2 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:16.682546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f4bd-9e2f-4535-9db8-6987dff5f5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:16.682626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511f4bd-9e2f-4535-9db8-6987dff5f5c2 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:16.683949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 677/1350] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:16.689769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744385-9da6-45ad-8bae-ea1f36832b9e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:16.690587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744385-9da6-45ad-8bae-ea1f36832b9e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:16.691197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74744385-9da6-45ad-8bae-ea1f36832b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:16.798748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-74744385-9da6-45ad-8bae-ea1f36832b9e None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:16.799935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-74744385-9da6-45ad-8bae-ea1f36832b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:16.824705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:16.935104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 674/1351] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:13:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:21.415898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314664-253e-4d4f-b32d-916d88ff0437 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:21.416473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314664-253e-4d4f-b32d-916d88ff0437 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:21.416473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb314664-253e-4d4f-b32d-916d88ff0437 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:21.417826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 678/1352] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:21.423486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93205275-78d5-489b-936c-85135cb03caf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:21.423930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93205275-78d5-489b-936c-85135cb03caf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:21.424047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93205275-78d5-489b-936c-85135cb03caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:21.520769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-93205275-78d5-489b-936c-85135cb03caf None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:21.522332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-93205275-78d5-489b-936c-85135cb03caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:21.619169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:21.668135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 675/1353] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:13:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:23.287802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20b62-ac2f-4967-92bc-8fb0e2727e0a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:23.288429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20b62-ac2f-4967-92bc-8fb0e2727e0a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:23.288429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e20b62-ac2f-4967-92bc-8fb0e2727e0a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:23.289825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 679/1354] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:23.296212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a24d-7ae8-4d10-949a-d59d1ff0af10 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:23.296751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a24d-7ae8-4d10-949a-d59d1ff0af10 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:23.296751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55a24d-7ae8-4d10-949a-d59d1ff0af10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:23.388393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4a55a24d-7ae8-4d10-949a-d59d1ff0af10 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:23.389693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4a55a24d-7ae8-4d10-949a-d59d1ff0af10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:23.513407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 676/1355] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:13:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:26.639019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6925-f103-45ee-abcb-479dead98d84 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:26.639550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6925-f103-45ee-abcb-479dead98d84 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:26.639550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d6925-f103-45ee-abcb-479dead98d84 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:26.640770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 680/1356] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:26.646515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb25f41-5ea7-4552-ad10-123a3b64e6a9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:26.647330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb25f41-5ea7-4552-ad10-123a3b64e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:26.647330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb25f41-5ea7-4552-ad10-123a3b64e6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:26.696146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:26.727557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1bb25f41-5ea7-4552-ad10-123a3b64e6a9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:26.728737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1bb25f41-5ea7-4552-ad10-123a3b64e6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:26.870533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 677/1357] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:27.166332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:27.166627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:27.166910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:27.168371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 681/1358] 10.222.0.61 () {54 vars in 962 bytes} [Sat Aug 27 02:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:27.177678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef313-1d16-4a2e-9f5d-e1715bc13a90 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:27.178273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef313-1d16-4a2e-9f5d-e1715bc13a90 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:27.179255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ef313-1d16-4a2e-9f5d-e1715bc13a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:27.274378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-bd7ef313-1d16-4a2e-9f5d-e1715bc13a90 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:27.275485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bd7ef313-1d16-4a2e-9f5d-e1715bc13a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:27.331146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:27.412431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 678/1359] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Aug 27 02:13:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:27.420438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:27.421982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:27.591228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfbcdbe-71fd-4de2-ace4-c7ba4cd40a19 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:27.679508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:27.724782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:27.725851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:27.726384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:27.726867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:27.728809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:27.830963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:27.832717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83549343-1bb4-4da3-8034-b0d3ae317fbc service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:27.851691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 682/1360] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:30.014362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:30.015396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:30.015891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:30.017908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 679/1361] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:30.023237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feda0-e49f-43b4-9cb4-66ebce86865e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:30.023713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feda0-e49f-43b4-9cb4-66ebce86865e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:30.023807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4feda0-e49f-43b4-9cb4-66ebce86865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:30.098004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6d4feda0-e49f-43b4-9cb4-66ebce86865e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:30.099201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6d4feda0-e49f-43b4-9cb4-66ebce86865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:30.161306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:30.242961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 683/1362] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:30.540079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:30.541649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:30.698882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9515083-f7ed-4c4e-9527-17663d7d207a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:30.708724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:30.829690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:30.830519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:30.830937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:30.831346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:30.833755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:30.945770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:30.947612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb56c79-d5fa-409b-bb04-859dce71901d service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:30.967315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 680/1363] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:33.236918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e7fa-246a-4af5-a4ca-ee3ff5a37454 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:33.237524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e7fa-246a-4af5-a4ca-ee3ff5a37454 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:33.237524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e7fa-246a-4af5-a4ca-ee3ff5a37454 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:33.238708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 684/1364] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:33.246892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a09fa-0e68-4513-9e31-692aea92488b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:33.248345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a09fa-0e68-4513-9e31-692aea92488b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:33.248345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a09fa-0e68-4513-9e31-692aea92488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:33.266134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:33.343859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-531a09fa-0e68-4513-9e31-692aea92488b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:33.345287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-531a09fa-0e68-4513-9e31-692aea92488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:33.457443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 681/1365] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:33.750506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:33.750807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:33.751195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:33.752793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 685/1366] 10.222.0.61 () {54 vars in 962 bytes} [Sat Aug 27 02:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:33.758420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74209-54ce-411f-a596-a522e9ae8152 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:33.758825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74209-54ce-411f-a596-a522e9ae8152 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:33.759201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec74209-54ce-411f-a596-a522e9ae8152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:33.840164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4ec74209-54ce-411f-a596-a522e9ae8152 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:33.841614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4ec74209-54ce-411f-a596-a522e9ae8152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:33.889846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:34.024321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 682/1367] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Aug 27 02:13:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:34.037318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:34.038955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:34.196404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4466ed-ee96-486a-b7ce-5fb4d510f608 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:34.224352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:34.327775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:34.328512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:34.328810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:34.328939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:34.330560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:34.429046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:34.432079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0709-5784-4d40-9049-492ae6b05914 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:34.453826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 686/1368] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:34.879418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e1ef-2e6c-4514-827e-7bce8059b8f6 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:34.879992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e1ef-2e6c-4514-827e-7bce8059b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:34.879992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064e1ef-2e6c-4514-827e-7bce8059b8f6 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:34.881549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 683/1369] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:34.886998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803c4a-5b1c-4e06-b414-de76d9613864 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:34.887398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803c4a-5b1c-4e06-b414-de76d9613864 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:34.887769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b803c4a-5b1c-4e06-b414-de76d9613864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:34.922252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:34.960730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2b803c4a-5b1c-4e06-b414-de76d9613864 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:34.961993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2b803c4a-5b1c-4e06-b414-de76d9613864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:35.067095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 687/1370] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:35.651237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:35.651237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:35.651237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:35.653548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 684/1371] 10.222.0.61 () {54 vars in 964 bytes} [Sat Aug 27 02:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:35.658638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae148-7f17-45f0-80f3-9597ff151fd3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:35.658638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae148-7f17-45f0-80f3-9597ff151fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:35.658638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae148-7f17-45f0-80f3-9597ff151fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:35.747579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cd2ae148-7f17-45f0-80f3-9597ff151fd3 None None] MFA Rules not processed for user `24b6f745fb3e4451b182536941eb21d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:35.748814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cd2ae148-7f17-45f0-80f3-9597ff151fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:35.798225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:35.830632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 688/1372] 10.222.0.61 () {58 vars in 1061 bytes} [Sat Aug 27 02:13:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:35.838330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:35.839892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:35.952496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517cb7a-79c6-421f-afe3-980257b6ce8d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:36.010538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:36.063482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:36.064406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:36.064872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:36.065311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:36.067990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:36.212872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:36.214322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c17e4-ca87-46f4-816e-b1f267722d3a service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:36.237066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 685/1373] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:13:36.446298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:36.446575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:36.446843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:36.448200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 689/1374] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:36.453732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9e7-f45f-42bb-9103-8a1e5acb97c1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:36.453967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9e7-f45f-42bb-9103-8a1e5acb97c1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:36.454246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678c9e7-f45f-42bb-9103-8a1e5acb97c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:36.524647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3678c9e7-f45f-42bb-9103-8a1e5acb97c1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:36.525919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3678c9e7-f45f-42bb-9103-8a1e5acb97c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:36.548163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:36.623827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 686/1375] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:36.906226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:36.908397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:37.071968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7f45c-96db-468a-aff1-8ee1feb2bd2e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:37.137872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:37.202593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:37.203196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:37.203595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:37.203897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:37.205729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:37.301512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:37.303120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c86e4b-8c12-4723-b92d-a906f336583a service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:37.325294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 690/1376] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:13:39.243276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:39.244079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:39.244079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:39.246088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 687/1377] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:39.256760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84b0c-9bf7-4562-8d7e-9453e49ef642 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:39.257258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84b0c-9bf7-4562-8d7e-9453e49ef642 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:39.257791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c84b0c-9bf7-4562-8d7e-9453e49ef642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:39.330962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-92c84b0c-9bf7-4562-8d7e-9453e49ef642 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:39.332160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-92c84b0c-9bf7-4562-8d7e-9453e49ef642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:39.341972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:39.446477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 691/1378] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:39.742518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:39.744011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:39.955771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281fbc6-dbe4-4857-a64c-289752ff0613 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:39.959980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:40.082614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:40.083164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:40.083450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:40.083719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:40.085594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:40.188246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:40.189898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d073d794-2cc8-4562-b90c-35c2c3ff91f6 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:40.211040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 688/1379] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:42.167919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:42.168350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:42.168674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:42.174839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 692/1380] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:42.176053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9382-df71-4f76-b95a-032eeb860a6c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:42.176459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9382-df71-4f76-b95a-032eeb860a6c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:42.177268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c9382-df71-4f76-b95a-032eeb860a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:42.188518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:42.265809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1e6c9382-df71-4f76-b95a-032eeb860a6c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:42.267798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1e6c9382-df71-4f76-b95a-032eeb860a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:42.396788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 689/1381] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:13:42.696550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:42.698175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:42.844773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:42.856806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db34a12-643c-4f75-a149-cd82ad822248 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:42.996390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:42.997457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:42.998111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:42.998567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:43.000224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:43.108365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:43.111001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc355279-a155-4b32-9114-9b09e408c48c service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:43.123454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:43.141478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 693/1382] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:45.127303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:45.127857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:45.127946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:45.129551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 690/1383] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:45.136960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2d14-3160-41f9-b080-537122f8ca33 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:45.137497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2d14-3160-41f9-b080-537122f8ca33 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:45.137673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c2d14-3160-41f9-b080-537122f8ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:45.246362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-934c2d14-3160-41f9-b080-537122f8ca33 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:45.248127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-934c2d14-3160-41f9-b080-537122f8ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:45.368014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 694/1384] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:45.733675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:45.735154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:45.840228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:45.908227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03979bf3-fc04-4825-91b8-253ddb7bb1e4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:46.040927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:46.041705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:46.042115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:46.042523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:46.045261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:46.103323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:46.152759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:46.154480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483df52-1aef-4e47-a3a8-e72bbbd0defc service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:46.179093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 691/1385] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:48.223464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:48.224045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:48.224153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:48.226253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 695/1386] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:48.233899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453cf7-4d78-4a3f-801b-3c1d2b1a62e1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:48.234728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453cf7-4d78-4a3f-801b-3c1d2b1a62e1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:48.234728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453cf7-4d78-4a3f-801b-3c1d2b1a62e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:48.316921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c1453cf7-4d78-4a3f-801b-3c1d2b1a62e1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:48.318873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c1453cf7-4d78-4a3f-801b-3c1d2b1a62e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:48.461053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 692/1387] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:48.809501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:48.811096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:48.904004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:48.991112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa2e2e-1100-47bb-bb08-7c25dc4160be None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:49.151643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:49.152526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:49.153044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:49.153537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:49.155904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:49.202231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:49.271764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:49.274425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de5ac5-f683-440c-b0f4-df2939cbc5c1 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:49.294233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 696/1388] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:51.315490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d765-7e4b-4c35-ab73-d867312ea3b4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:51.315950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d765-7e4b-4c35-ab73-d867312ea3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:51.315950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d765-7e4b-4c35-ab73-d867312ea3b4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:51.317201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 693/1389] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:51.323690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b72-d540-45f2-9f12-4ca804bd6b73 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:51.324416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b72-d540-45f2-9f12-4ca804bd6b73 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:51.324416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b72-d540-45f2-9f12-4ca804bd6b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:51.398975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0c317b72-d540-45f2-9f12-4ca804bd6b73 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:51.400227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0c317b72-d540-45f2-9f12-4ca804bd6b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:51.504166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 697/1390] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:13:51.724554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:51.724962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:51.725305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:51.726806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 694/1391] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:51.733198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ccde-8f99-4b40-ae87-16a1fc66a2a6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:51.733622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ccde-8f99-4b40-ae87-16a1fc66a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:51.733907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2ccde-8f99-4b40-ae87-16a1fc66a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:51.760431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:51.797895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:51.799518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:51.823104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-83e2ccde-8f99-4b40-ae87-16a1fc66a2a6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:51.824459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-83e2ccde-8f99-4b40-ae87-16a1fc66a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:51.834221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:51.941821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 698/1392] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:51.975014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969741ca-e675-49a1-9ae3-9dc9e7e15a85 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:52.090765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:52.106621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:52.107375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:52.107649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:52.108163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:52.110041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:52.226773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:52.228615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baadf71-1621-4dcf-9697-66299cd57e69 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:52.251475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 695/1393] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:52.269704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:52.269989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:52.270248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:52.271609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 699/1394] 10.222.0.61 () {54 vars in 967 bytes} [Sat Aug 27 02:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:52.277547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f541b6-5409-4058-a260-cbf90afc422f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:52.277872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f541b6-5409-4058-a260-cbf90afc422f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:52.278118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f541b6-5409-4058-a260-cbf90afc422f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:52.378512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e8f541b6-5409-4058-a260-cbf90afc422f None None] MFA Rules not processed for user `e5b1a97a2fad45899863619a3953e0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:52.379796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e8f541b6-5409-4058-a260-cbf90afc422f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:52.455233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:52.482151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 696/1395] 10.222.0.61 () {58 vars in 1064 bytes} [Sat Aug 27 02:13:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:52.489688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:52.491253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:52.615032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:52.626389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f6945-434d-475c-ba2c-0552761f46a6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:52.729813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:52.730429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:52.730706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:52.730975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:52.732715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:52.863252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:52.864718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a936f1-bc24-4229-9ce9-49ae89d39a4b service glance] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:52.897804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 700/1396] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:53.634380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102945f-6f9f-4088-b601-816fa6579998 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:53.634916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102945f-6f9f-4088-b601-816fa6579998 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:53.635241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102945f-6f9f-4088-b601-816fa6579998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:53.710805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b102945f-6f9f-4088-b601-816fa6579998 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:53.712054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b102945f-6f9f-4088-b601-816fa6579998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:53.809013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 697/1397] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:13:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:53.855266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:53.855801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:53.855941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:53.857665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 701/1398] 10.222.0.61 () {54 vars in 943 bytes} [Sat Aug 27 02:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:53.864417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9796-6b81-4426-8fa4-05723e7a9d33 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:53.864766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9796-6b81-4426-8fa4-05723e7a9d33 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:53.865049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb9796-6b81-4426-8fa4-05723e7a9d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:53.948157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f9fb9796-6b81-4426-8fa4-05723e7a9d33 None None] MFA Rules not processed for user `6e7b457718554fac8c6e8fefea700674`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:53.949289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f9fb9796-6b81-4426-8fa4-05723e7a9d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:53.963895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:54.068234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 698/1399] 10.222.0.61 () {58 vars in 1040 bytes} [Sat Aug 27 02:13:53 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:54.082981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:54.085689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:54.120360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:54.213788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0eeb4-7276-4ec1-b1cd-c79628d41d01 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:54.214011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0eeb4-7276-4ec1-b1cd-c79628d41d01 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:54.214282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0eeb4-7276-4ec1-b1cd-c79628d41d01 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:54.215656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 699/1400] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:54.221227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:54.221547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:54.221822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:54.259770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90a3e0-1e8e-44c3-83c5-42fda2f9143e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:54.293529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:54.294993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:54.376019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:54.382301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:54.382911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:54.383189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:54.383446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:54.385174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:54.392988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:54.403370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 700/1401] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:54.478456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:54.479995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca13c65-593d-4414-960c-4664e4930144 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:54.488814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 702/1402] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:13:54.711645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:54.712855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:54.876441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651d95e-68f4-456f-b087-056db6032ea0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:54.972421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:55.001073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:55.001727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:55.002006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:55.002278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:55.006882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:55.115562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:55.117310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9eb984-f9c2-406f-b17a-37fc8daf8369 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:55.139123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 701/1403] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:13:57.107264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:57.107905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:57.107905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:57.109229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 703/1404] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:13:57.114733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195e2e-e83d-435d-a0ce-cb8fd8e86d04 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:57.115510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195e2e-e83d-435d-a0ce-cb8fd8e86d04 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:57.116045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab195e2e-e83d-435d-a0ce-cb8fd8e86d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:57.192577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ab195e2e-e83d-435d-a0ce-cb8fd8e86d04 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:13:57.193859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ab195e2e-e83d-435d-a0ce-cb8fd8e86d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:57.269982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:57.328553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 702/1405] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:13:57.616047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:13:57.617613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:57.844534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e033fbb-3138-4fce-93ab-ccd1cad8ac76 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:13:57.847662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:13:57.989275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:13:57.990103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:13:57.990447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:13:57.990929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:13:57.993144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:13:58.103907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:13:58.105625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94142145-09f9-4bef-b2ef-176a9009a9ad service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:13:58.129016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 704/1406] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:00.099719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:00.099719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:00.099719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:00.107099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 703/1407] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:00.107286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2cde-f0ee-40e6-af6f-e8424060f596 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:00.107286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2cde-f0ee-40e6-af6f-e8424060f596 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:00.107286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb2cde-f0ee-40e6-af6f-e8424060f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:00.117025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:00.194767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-08bb2cde-f0ee-40e6-af6f-e8424060f596 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:00.196428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-08bb2cde-f0ee-40e6-af6f-e8424060f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:00.301682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 705/1408] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:00.597994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:00.599702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:00.792971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708357cb-61f2-49d1-b4fe-64a2b6d0c04d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:00.841942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:00.958504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:00.959815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:00.960815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:00.960815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:00.965583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:01.083171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:01.084978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0156-99cc-40c4-a61e-917dde5d0d5b service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:01.103834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 704/1409] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:10.299999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=62 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:11.101170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=82 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:16.731912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11637ec-255a-4929-a077-0fc5480969a4 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:16.732480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11637ec-255a-4929-a077-0fc5480969a4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:16.732480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11637ec-255a-4929-a077-0fc5480969a4 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:16.733907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 706/1410] 10.222.0.61 () {54 vars in 918 bytes} [Sat Aug 27 02:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:16.740164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f864a-7652-4873-aead-a80b60006864 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:16.740691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f864a-7652-4873-aead-a80b60006864 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:16.740807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f864a-7652-4873-aead-a80b60006864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:16.818700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b30f864a-7652-4873-aead-a80b60006864 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:16.819898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b30f864a-7652-4873-aead-a80b60006864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:16.925956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 705/1411] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Aug 27 02:14:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:16.940910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119250ee-3e0e-415f-8d1e-bbe8cab1b2d3 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:16.941200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119250ee-3e0e-415f-8d1e-bbe8cab1b2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:16.941510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119250ee-3e0e-415f-8d1e-bbe8cab1b2d3 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:16.943503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 707/1412] 10.222.0.61 () {54 vars in 918 bytes} [Sat Aug 27 02:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:16.948603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6fef0-5815-45ab-9a53-b62f731d8fda None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:16.948948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6fef0-5815-45ab-9a53-b62f731d8fda None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:16.949262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6fef0-5815-45ab-9a53-b62f731d8fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:17.024361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:17.027861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-02b6fef0-5815-45ab-9a53-b62f731d8fda None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:17.029662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-02b6fef0-5815-45ab-9a53-b62f731d8fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:17.149577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 706/1413] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Aug 27 02:14:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:19.556812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:19.557423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:19.557423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:19.558773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:19.565603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3e9d-3338-4cf5-b69d-f23cabd1ae77 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:19.566149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3e9d-3338-4cf5-b69d-f23cabd1ae77 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:19.566434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb3e9d-3338-4cf5-b69d-f23cabd1ae77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:19.643936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-accb3e9d-3338-4cf5-b69d-f23cabd1ae77 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:19.645161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-accb3e9d-3338-4cf5-b69d-f23cabd1ae77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:19.703740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:19.754578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:20.046108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:20.047788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:20.223804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38fdff-3edf-4e28-a3c0-b0f619c3a16d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:20.302454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:20.346260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:20.346868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:20.347142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:20.347406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:20.348988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:20.456720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:20.458186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4f1ec-4d97-4a82-b71a-6b4a9d11e569 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:20.478203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 709/1416] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:21.381346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:21.381984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:21.381984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:21.384016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:21.389851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17107-47fd-4431-8873-1ebb9ba96630 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:21.390348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17107-47fd-4431-8873-1ebb9ba96630 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:21.390348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17107-47fd-4431-8873-1ebb9ba96630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:21.479599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e3c17107-47fd-4431-8873-1ebb9ba96630 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:21.481074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e3c17107-47fd-4431-8873-1ebb9ba96630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:21.511109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:21.588185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:14:21.744000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:21.745556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:21.897893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfe596-6054-4460-ad6c-0e91e03c7156 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:21.939796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:22.030173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:22.030805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:22.031071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:22.031339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:22.032942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:22.127061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:22.128665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b4d2d-e0b4-4d99-a1d4-e1bea5bbc328 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:22.147517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 709/1419] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:23.055395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:23.056038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:23.056038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:23.057377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:23.062657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f60c5-7113-4b08-a2f9-a2feab36f5ca None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:23.063173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f60c5-7113-4b08-a2f9-a2feab36f5ca None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:23.063300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f60c5-7113-4b08-a2f9-a2feab36f5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:23.124047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:23.149096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-315f60c5-7113-4b08-a2f9-a2feab36f5ca None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:23.150275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-315f60c5-7113-4b08-a2f9-a2feab36f5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:23.250596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:23.401105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:23.403063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:23.561096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b3148-eccd-468a-b4ec-ce4bbe3a38c8 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:23.574605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:23.689403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:23.690037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:23.690322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:23.690570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:23.692166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:23.797635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:23.799251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0b0a3-2eaa-414f-b6a4-4e685cc94179 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:23.818635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 712/1422] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:24.698358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:24.698935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:24.698935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:24.700506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:24.706837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445fa58-58af-4183-9ec2-059f3c92aeef None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:24.707621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445fa58-58af-4183-9ec2-059f3c92aeef None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:24.707772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445fa58-58af-4183-9ec2-059f3c92aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:24.736239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:24.800428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c445fa58-58af-4183-9ec2-059f3c92aeef None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:24.801681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c445fa58-58af-4183-9ec2-059f3c92aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:24.912680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:25.065981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:25.067525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:25.194549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:25.235922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa6682-b688-45d6-a8cc-4622f862be49 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:25.364243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:25.364843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:25.365119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:25.365384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:25.366991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:25.456020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:25.473010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:25.475418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff83548-0e6b-4d0a-8318-eaec3c85e982 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:25.495627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 712/1425] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:26.381614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:26.382214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:26.382214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:26.384012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:26.389830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6beb-ea1d-4558-b29c-ac2ea3a789b9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:26.390292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6beb-ea1d-4558-b29c-ac2ea3a789b9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:26.390404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc6beb-ea1d-4558-b29c-ac2ea3a789b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:26.476546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1bdc6beb-ea1d-4558-b29c-ac2ea3a789b9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:26.477804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1bdc6beb-ea1d-4558-b29c-ac2ea3a789b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:26.584017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:26.738903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:26.740582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:26.835728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:26.906065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3a8cd-7531-4109-810e-42c72e8970f5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:27.034152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:27.034761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:27.035039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:27.035307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:27.038145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:27.101007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:27.150284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:27.152787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288aca6b-8b57-45de-bebb-173a2251a221 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:27.172632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 715/1428] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:27.990121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:27.990911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:27.990911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:27.992519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:27.998608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf3a0-bc9e-4662-9ed0-e69544ff7d51 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:27.999086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf3a0-bc9e-4662-9ed0-e69544ff7d51 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:27.999194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74bf3a0-bc9e-4662-9ed0-e69544ff7d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:28.080603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a74bf3a0-bc9e-4662-9ed0-e69544ff7d51 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:28.082888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a74bf3a0-bc9e-4662-9ed0-e69544ff7d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:28.194775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:28.347899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:28.349321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:28.409984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:28.517968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22689f-c9d4-46b5-9e0b-ba1d862c9603 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:28.637282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:28.637820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:28.638099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:28.638346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:28.639928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:28.647612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:28.737055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:28.738699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b64b90-1c14-4168-8604-4853c075e2dd service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:28.757745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 715/1431] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:29.576902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:29.577513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:29.577513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:29.578781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:29.584381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5492fe-a22e-4f59-a9e0-8bb3886473af None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:29.584846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5492fe-a22e-4f59-a9e0-8bb3886473af None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:29.584952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5492fe-a22e-4f59-a9e0-8bb3886473af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:29.663104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4d5492fe-a22e-4f59-a9e0-8bb3886473af None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:29.664300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4d5492fe-a22e-4f59-a9e0-8bb3886473af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:29.732922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:29.762192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:29.911922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:29.913522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:29.932161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:30.064075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8297-bb44-497a-9ba5-8a97d1f8c2cd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:30.153332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:30.180453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:30.181048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:30.181319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:30.181617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:30.183189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:30.275261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:30.276870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5506cc-7e71-49e1-a73c-d8f603c56c7e service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:30.295761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 718/1434] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:31.096655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:31.097270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:31.097270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:31.098622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:31.103747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319028cf-6dd9-4847-9724-84c0b8c59461 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:31.104203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319028cf-6dd9-4847-9724-84c0b8c59461 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:31.104312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319028cf-6dd9-4847-9724-84c0b8c59461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:31.184097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-319028cf-6dd9-4847-9724-84c0b8c59461 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:31.185270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-319028cf-6dd9-4847-9724-84c0b8c59461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:31.228773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:31.285563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:31.432790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:31.434380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:31.587076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679d547-83b5-4baa-8037-9e728cd89935 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:31.641377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:31.707227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:31.707851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:31.708101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:31.708391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:31.710398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:31.804328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:31.806001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa63183-c09b-4739-99b3-13de542b676b service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:31.824276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 718/1437] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:32.617178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:32.617799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:32.617799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:32.619110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:32.624355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea865-8e39-4434-a15d-0308047dfadd None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:32.624790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea865-8e39-4434-a15d-0308047dfadd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:32.624921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea865-8e39-4434-a15d-0308047dfadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:32.705939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cc1ea865-8e39-4434-a15d-0308047dfadd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:32.707162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cc1ea865-8e39-4434-a15d-0308047dfadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:32.709199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:32.809415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:32.960152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:32.961589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:33.111329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6fee-0ab2-4c81-ad97-2ac6a5a8f584 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:33.139836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:33.234618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:33.235133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:33.235407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:33.235700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:33.237304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:33.331001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:33.332612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50dd65-70e7-4671-8ae7-db6302ec235c service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:33.353015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 721/1440] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:35.181443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:35.182070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:35.182070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:35.183486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:35.190278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d6123-59b5-4ccf-8eb0-4aa47ae98821 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:35.190779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d6123-59b5-4ccf-8eb0-4aa47ae98821 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:35.190871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d6123-59b5-4ccf-8eb0-4aa47ae98821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:35.245029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:35.274195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4a9d6123-59b5-4ccf-8eb0-4aa47ae98821 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:35.275420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4a9d6123-59b5-4ccf-8eb0-4aa47ae98821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:35.385763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:35.672374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:35.673942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:35.799181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdbb8f-3be3-4bd9-84bc-84e3875bed5b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:35.832784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:35.879765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:35.880389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:35.880675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:35.880941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:35.882594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:36.011677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:36.013058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb5a2c-5ae7-4c5c-a296-cdae6e53d045 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:36.032625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 721/1443] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:38.102855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:38.103451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:38.103451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:38.104923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:38.110912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f0dd-6ace-4d32-a198-bc1a86ca8857 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:38.111422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f0dd-6ace-4d32-a198-bc1a86ca8857 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:38.111524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6f0dd-6ace-4d32-a198-bc1a86ca8857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:38.180805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c6a6f0dd-6ace-4d32-a198-bc1a86ca8857 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:38.182025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c6a6f0dd-6ace-4d32-a198-bc1a86ca8857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:38.195827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:38.290055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:14:38.577549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:38.579086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:38.697338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0725825-f873-4094-a587-9e4167d8ec08 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:38.710422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:38.777200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:38.777822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:38.778128 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:38.778383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:38.780034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:38.896713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:38.898421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdd43-a219-4a39-a02c-92e0265a8b40 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:38.919326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 724/1446] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:41.255299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:41.255844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:41.255844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:41.257244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:41.263274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f9881-2a92-4606-8e62-48401106cf48 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:41.263792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f9881-2a92-4606-8e62-48401106cf48 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:41.263792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f9881-2a92-4606-8e62-48401106cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:41.316297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:41.340554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fd9f9881-2a92-4606-8e62-48401106cf48 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:41.341844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fd9f9881-2a92-4606-8e62-48401106cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:41.447047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:41.728193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:41.730109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:41.848442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e55541-0e02-47b0-92a4-74c9b7cf0567 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:41.891030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:41.927785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:41.928397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:41.928647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:41.928950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:41.930611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:42.053236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:42.054619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f500e-36c1-4c48-9bb1-566dc40b4d40 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:42.078659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 724/1449] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:44.148190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:44.148826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:44.148826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:44.150102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:44.155942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad026-677b-458b-830a-061af7035102 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:44.156431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad026-677b-458b-830a-061af7035102 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:44.156535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad026-677b-458b-830a-061af7035102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:44.229327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e95ad026-677b-458b-830a-061af7035102 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:44.230676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e95ad026-677b-458b-830a-061af7035102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:44.252518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:44.334569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:44.616604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:44.618194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:44.733401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac7b4-47e8-4c9c-9219-37ad2618e520 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:44.754522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:44.820684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:44.821298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:44.821605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:44.821875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:44.823527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:44.941001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:44.942404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda3fa6-9c0d-4825-9ccc-2e91f1cd3243 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:44.961893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 727/1452] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:47.002838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:47.003406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:47.003406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:47.004748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:47.010696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab268-7e13-42a0-9736-d2465e38dc5b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:47.011249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab268-7e13-42a0-9736-d2465e38dc5b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:47.011344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ab268-7e13-42a0-9736-d2465e38dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:47.085600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:47.088507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3b0ab268-7e13-42a0-9736-d2465e38dc5b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:47.090372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3b0ab268-7e13-42a0-9736-d2465e38dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:47.201137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:47.486042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:47.487584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:47.606706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebfa33-2b8a-456c-b6bc-0f4734583469 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:47.660683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:47.691735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:47.692351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:47.692629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:47.692898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:47.694559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:47.819425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:47.820903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d11d6-4238-4df6-be3a-27f87af79446 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:47.840462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 727/1455] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:49.915669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:49.916228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:49.916228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:49.917714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:49.923490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671549-a1f9-4757-929c-d05bfe06cc36 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:49.923999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671549-a1f9-4757-929c-d05bfe06cc36 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:49.923999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d671549-a1f9-4757-929c-d05bfe06cc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:49.998663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9d671549-a1f9-4757-929c-d05bfe06cc36 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:49.999884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9d671549-a1f9-4757-929c-d05bfe06cc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:50.034732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:50.107673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:50.386443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:50.387989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:50.509050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad49a66-1a89-4291-91d2-11a4e18ca5bd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:50.539594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:50.594020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:50.594600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:50.594877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:50.595149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:50.596810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:50.717533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:50.718917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170975c-6438-40b4-a116-2c176d3509c1 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:50.739309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 730/1458] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:52.717912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:52.718512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:52.718512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:52.719782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:52.725570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43c79-a1e0-41ed-add1-6ff436b9d00f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:52.726075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43c79-a1e0-41ed-add1-6ff436b9d00f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:52.726075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43c79-a1e0-41ed-add1-6ff436b9d00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:52.801532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3ad43c79-a1e0-41ed-add1-6ff436b9d00f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:52.802751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3ad43c79-a1e0-41ed-add1-6ff436b9d00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:52.812206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:52.916412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:53.201439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:53.202633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:53.330591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ceae6-8036-4a80-8731-4839405a28c5 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:53.409840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:53.431113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:53.431767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:53.432045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:53.432312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:53.434353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:53.562953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:53.564318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab070e-0f56-4724-8029-6c713f3d4356 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:53.583959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 730/1461] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:55.547121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:55.547767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:55.547767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:55.549060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:55.554851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa574-9a20-41ff-9e95-12e7d383b28b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:55.555319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa574-9a20-41ff-9e95-12e7d383b28b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:55.555445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aa574-9a20-41ff-9e95-12e7d383b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:55.628649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f84aa574-9a20-41ff-9e95-12e7d383b28b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:55.629943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f84aa574-9a20-41ff-9e95-12e7d383b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:55.672461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:55.743694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:56.024935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:56.026584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:56.148620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf5b2e-ee81-4d1a-b529-21c8765761a9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:56.188269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:56.232367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:56.233005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:56.233277 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:56.233583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:56.235211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:56.357627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:56.359087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5b242-965b-4ce1-b0b3-e0f1599be09b service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:56.381529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 733/1464] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:14:58.343428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:58.343960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:58.343960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:58.345310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:14:58.350868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc190a-e04b-4569-a330-e83bf70317f0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:58.351296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc190a-e04b-4569-a330-e83bf70317f0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:58.351387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc190a-e04b-4569-a330-e83bf70317f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:58.426464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-28bc190a-e04b-4569-a330-e83bf70317f0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:14:58.428193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28bc190a-e04b-4569-a330-e83bf70317f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:58.451275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:58.537904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:14:58.818048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:14:58.819538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:58.943080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a120-3e01-4ae1-99ae-6c0647ad3300 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:14:59.022428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:14:59.029604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:14:59.030215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:14:59.030481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:14:59.030751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:14:59.032376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:14:59.147284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:14:59.148718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38f9dd-5945-422a-9452-0ab7a7b3b816 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:14:59.168530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 733/1467] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:01.104416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:01.105200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:01.105200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:01.106544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:01.112091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5dfa-f69a-4dc2-9939-22132b059e3a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:01.112586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5dfa-f69a-4dc2-9939-22132b059e3a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:01.112694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5dfa-f69a-4dc2-9939-22132b059e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:01.183056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c89b5dfa-f69a-4dc2-9939-22132b059e3a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:01.184263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c89b5dfa-f69a-4dc2-9939-22132b059e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:01.236919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:01.291073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:01.591591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:01.593155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:01.711231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071234e-f0bd-492a-acaf-114bc069e1f7 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:01.760832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:01.790564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:01.791173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:01.791473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:01.791778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:01.793434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:01.914240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:01.915592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36982119-15ad-4b6b-bf5c-17c5593cb82d service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:01.935132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 736/1470] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:11.288848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=22 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:11.932475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=66 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:21.332276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5b58-a632-487d-a3e0-c4faae0bfd05 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:21.332861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5b58-a632-487d-a3e0-c4faae0bfd05 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:21.332861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5b58-a632-487d-a3e0-c4faae0bfd05 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:21.334184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 735/1471] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:21.339901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c64a7-a303-482c-9380-349488b6e888 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:21.340351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c64a7-a303-482c-9380-349488b6e888 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:21.340455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c64a7-a303-482c-9380-349488b6e888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:21.411468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ce6c64a7-a303-482c-9380-349488b6e888 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:21.412690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ce6c64a7-a303-482c-9380-349488b6e888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:21.522871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 737/1472] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:21.813664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:21.813943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:21.814210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:21.815613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 736/1473] 10.222.0.61 () {54 vars in 967 bytes} [Sat Aug 27 02:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:21.820566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7d30-b281-4139-b389-8ce5b5b58d55 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:21.820831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7d30-b281-4139-b389-8ce5b5b58d55 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:21.821105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7d30-b281-4139-b389-8ce5b5b58d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:21.899378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-021f7d30-b281-4139-b389-8ce5b5b58d55 None None] MFA Rules not processed for user `e5b1a97a2fad45899863619a3953e0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:21.900620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-021f7d30-b281-4139-b389-8ce5b5b58d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:21.921483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:21.978906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 738/1474] 10.222.0.61 () {58 vars in 1064 bytes} [Sat Aug 27 02:15:21 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:21.986829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:21.988340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:22.098137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7da12f-eee1-4138-be72-d4e3a0f860d3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:22.175599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:22.176213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:22.176542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:22.176815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:22.178465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:22.234250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:22.289547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:22.290986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51e36d-3e1f-4f36-b884-5a952e16be3f service glance] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:22.310337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 737/1475] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:24.312750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:24.312750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:24.312750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:24.314137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 739/1476] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:24.320198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac904-2909-4d2c-a803-a8b15b5b4036 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:24.320798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac904-2909-4d2c-a803-a8b15b5b4036 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:24.320798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbac904-2909-4d2c-a803-a8b15b5b4036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:24.393040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-bdbac904-2909-4d2c-a803-a8b15b5b4036 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:24.394214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bdbac904-2909-4d2c-a803-a8b15b5b4036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:24.498447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 738/1477] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:24.768066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:24.769541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:24.900060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b19460-9b31-47cb-ae48-22fb185bd6f3 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:24.952194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:24.999229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:24.999832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:25.000105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:25.000375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:25.001009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:25.002890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:15:25.002890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:15:25.002890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:15:25.004068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80ef82-e401-4952-a898-c8043efa4fc1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:25.030059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 740/1478] 10.222.0.61 () {56 vars in 1108 bytes} [Sat Aug 27 02:15:24 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:15:26.944421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:26.944962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:26.944962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:26.946878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 739/1479] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:26.954162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025cb79-36df-4713-b774-f12d5a28233a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:26.954594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025cb79-36df-4713-b774-f12d5a28233a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:26.954694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025cb79-36df-4713-b774-f12d5a28233a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:27.028427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9025cb79-36df-4713-b774-f12d5a28233a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:27.029743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9025cb79-36df-4713-b774-f12d5a28233a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:27.128549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 741/1480] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:27.422326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:27.424049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:27.434613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:27.578292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32b64a9-755a-45f8-aa7b-a5efa29ecd45 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:27.661745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:27.697013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:27.697721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:27.698005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:27.698279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:27.699907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:27.796689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:27.798440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088b9526-c58a-48c3-9f6e-2585eea98b5c service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:27.819541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 740/1481] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:30.009714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:30.010857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:30.010857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:30.012768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 742/1482] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:30.022527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bc94-caa8-4edd-8d81-6d82df5c0147 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:30.023028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bc94-caa8-4edd-8d81-6d82df5c0147 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:30.023132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bc94-caa8-4edd-8d81-6d82df5c0147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:30.096403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cdb0bc94-caa8-4edd-8d81-6d82df5c0147 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:30.097652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cdb0bc94-caa8-4edd-8d81-6d82df5c0147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:30.147143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:30.199772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 741/1483] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:30.484539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:30.486150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:30.511798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:30.597677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b42b30-1261-4f04-8d4f-3d5ab4617a02 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:30.678473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:30.679079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:30.679358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:30.679627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:30.681306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:30.760324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:30.798197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:30.799662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a946dc4-27fa-4a77-ba88-b0056248138b service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:30.817999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 743/1484] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:32.791002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:32.791575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:32.791575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:32.792939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 742/1485] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:32.800969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17289-6db0-45f0-a596-32a1856b2eab None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:32.801437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17289-6db0-45f0-a596-32a1856b2eab None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:32.801550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b17289-6db0-45f0-a596-32a1856b2eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:32.875713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-24b17289-6db0-45f0-a596-32a1856b2eab None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:32.876921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-24b17289-6db0-45f0-a596-32a1856b2eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:32.977639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 744/1486] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:33.277424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:33.279013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:33.402571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbed23-7481-4a31-8d55-a8635f5003e4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:33.485427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:33.487526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:33.488094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:33.488379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:33.488678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:33.491191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:33.607781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:33.609224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e0cc4-4763-419e-a85e-b461bb8b12a0 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:33.628644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 743/1487] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:35.636201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:35.636752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:35.636752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:35.638136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 745/1488] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:35.643906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e15a2-b63c-493a-a26e-f19679e838cf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:35.644415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e15a2-b63c-493a-a26e-f19679e838cf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:35.644525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e15a2-b63c-493a-a26e-f19679e838cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:35.717580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a44e15a2-b63c-493a-a26e-f19679e838cf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:35.719670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a44e15a2-b63c-493a-a26e-f19679e838cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:35.778249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:35.822703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 744/1489] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:36.129085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:36.130681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:36.169587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:36.240440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87758d6-68d4-40f8-bb83-89c36df2855c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:36.319881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:36.320487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:36.320760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:36.321023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:36.322683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:36.406350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:36.436738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:36.438224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bddaa-d940-43c2-8812-70afcb0ef536 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:36.459195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 746/1490] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:38.613063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:38.613714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:38.613714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:38.615049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 745/1491] 10.222.0.61 () {54 vars in 927 bytes} [Sat Aug 27 02:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:15:38.620642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc553d-ef92-45e8-a1c4-04a12abfb7cc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:38.621089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc553d-ef92-45e8-a1c4-04a12abfb7cc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:38.621203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc553d-ef92-45e8-a1c4-04a12abfb7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:38.822403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f2cc553d-ef92-45e8-a1c4-04a12abfb7cc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:15:38.824144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f2cc553d-ef92-45e8-a1c4-04a12abfb7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:38.930294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 747/1492] 10.222.0.61 () {58 vars in 1024 bytes} [Sat Aug 27 02:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:15:39.220246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:15:39.222019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:39.335262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a87021-53fa-490d-9d59-5a19d1942a96 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:15:39.414981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:15:39.415570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:15:39.415845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:15:39.416111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:15:39.417742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:15:39.427160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:39.542067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:15:39.543424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8951fcd-273f-4be9-af97-acf48819bc98 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:15:39.562695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 746/1493] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:15:48.928194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=82 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:15:49.560139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=50 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:16:58.511057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:58.511686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:58.511686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:58.597256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:16:58.599460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:58.716789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 748/1494] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:16:58.725744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:58.726522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:58.726626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:58.826214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:16:58.827444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:58.925222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 747/1495] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:16:58.931486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:58.932670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:58.945411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e2fb-3252-45c5-a410-0a249261e89b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:16:59.007578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:16:59.043023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:16:59.043634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:59.043911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:59.044181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:59.044819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:16:59.045118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:16:59.046179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:16:59.046179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:16:59.046179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:16:59.047075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:16:59.060341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 749/1496] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:16:59.069373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:59.084559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0885659-e6b2-4890-b995-f0d5af315d11 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:16:59.153489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:16:59.191019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:16:59.191631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:59.191907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:59.192164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:59.192854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:16:59.195003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:16:59.195003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:16:59.195003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:16:59.196210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:16:59.252418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 748/1497] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:16:59 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:16:59.256718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:59.258319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:59.292496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bffb81-f4c8-4dbc-820c-991de03ee863 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:16:59.386134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:16:59.386720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:59.386989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:59.387253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:59.387880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:16:59.388872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:16:59.388872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:16:59.388872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:16:59.390081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:16:59.433565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 750/1498] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:16:59 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:16:59.438651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:59.440939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:59.520749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c460c5-1471-46c5-8808-0c6e02dc898f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:16:59.623908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:16:59.638339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:16:59.638958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:59.639238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:59.639504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:59.640148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:16:59.641162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:16:59.641162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:16:59.641162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:16:59.642096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:16:59.655594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 749/1499] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:16:59.659989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:59.661567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:59.673347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d310a5c-900d-452e-8a9b-29d9701a1bee admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:16:59.699007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:16:59.778808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:16:59.779409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:16:59.779679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:16:59.779947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:16:59.780592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:16:59.781619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:16:59.781619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:16:59.781619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:16:59.782521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7e67d-6117-4391-afe6-6142fa93bcfd admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:16:59.795601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 751/1500] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:16:59.800867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:16:59.803627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:16:59.839442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159beed-c57b-41d7-94b5-b42334180790 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:17:00.060128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:17:00.060676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.060964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.061222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] PATH_INFO: `/v3/projects/cd7e8359c0aa4334a9605aef06e00f46/users/927429950dde4b83ad65190415dace39/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.086012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7e8359c0aa4334a9605aef06e00f46, user_id=927429950dde4b83ad65190415dace39, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:17:00.087063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:17:00.087063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:17:00.087063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:17:00.088993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452b90b-6c7c-4722-a67d-dd03d78816ae admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:17:00.124178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 750/1501] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:16:59 2022] PUT /identity/v3/projects/cd7e8359c0aa4334a9605aef06e00f46/users/927429950dde4b83ad65190415dace39/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:17:00.136892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e97b-d81b-4aa7-aa96-9f017025814c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.137173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e97b-d81b-4aa7-aa96-9f017025814c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.137474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8e97b-d81b-4aa7-aa96-9f017025814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.197881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ccb8e97b-d81b-4aa7-aa96-9f017025814c None None] MFA Rules not processed for user `927429950dde4b83ad65190415dace39`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:17:00.199122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ccb8e97b-d81b-4aa7-aa96-9f017025814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:00.279718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 752/1502] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:17:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:17:00.294855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.295121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.295393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.297027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 751/1503] 10.222.0.61 () {54 vars in 964 bytes} [Sat Aug 27 02:17:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:17:00.303480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbe71-cfee-4d46-a203-9ace5df7be3d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.303761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbe71-cfee-4d46-a203-9ace5df7be3d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.304060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdbe71-cfee-4d46-a203-9ace5df7be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.350023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:00.425712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c6fdbe71-cfee-4d46-a203-9ace5df7be3d None None] MFA Rules not processed for user `24b6f745fb3e4451b182536941eb21d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:17:00.427420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c6fdbe71-cfee-4d46-a203-9ace5df7be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:00.527760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 753/1504] 10.222.0.61 () {58 vars in 1061 bytes} [Sat Aug 27 02:17:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:17:00.538928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:17:00.541009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:00.600046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:00.664524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2a751-cde6-45b2-bf24-93040df6be4d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:17:00.746893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:17:00.747505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.747764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.748029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.749703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:00.861735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:17:00.863094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:17:00.866661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:00.882002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 752/1505] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:17:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:17:00.935292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc955ef-42bb-4b65-a5ed-a6b74ece31e3 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:00.935745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc955ef-42bb-4b65-a5ed-a6b74ece31e3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:00.935840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc955ef-42bb-4b65-a5ed-a6b74ece31e3 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:00.937096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 754/1506] 10.222.0.61 () {52 vars in 830 bytes} [Sat Aug 27 02:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:17:00.941050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:17:00.942293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:01.057090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc852b4-8ec1-4dd8-a9eb-c3bcb59f60d8 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:17:01.151350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:17:01.151889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:01.152167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:01.152438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] PATH_INFO: `/v3/users/927429950dde4b83ad65190415dace39` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:01.167346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=927429950dde4b83ad65190415dace39)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:17:01.168399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:17:01.168399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:17:01.168399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:17:01.169676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:17:01.180814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:01.247374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '927429950dde4b83ad65190415dace39'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:01.264580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '927429950dde4b83ad65190415dace39'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:01.288654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '927429950dde4b83ad65190415dace39'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:01.289249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '927429950dde4b83ad65190415dace39'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:01.304698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '927429950dde4b83ad65190415dace39'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:01.311383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 753/1507] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:17:00 2022] DELETE /identity/v3/users/927429950dde4b83ad65190415dace39 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:17:01.316075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:01.316377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:01.316673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:01.373477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:17:01.374680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:01.453565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:01.469798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 755/1508] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:17:01.480426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:17:01.481702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:01.589126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d34d8-4e7a-4da7-808d-f6ca0c6a3ba4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:17:01.657386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:01.678997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:17:01.679617 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:01.679889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:01.680156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:01.681790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:01.803755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:17:01.805348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbfc3c-5012-44a5-9dda-4c80710159af service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:17:01.824522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 754/1509] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:17:02.190400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:17:02.192376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:17:02.212299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af99e7c-33de-4095-a629-2c7ca214c23a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:17:02.315709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:17:02.316349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:17:02.316616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:17:02.316877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] PATH_INFO: `/v3/projects/cd7e8359c0aa4334a9605aef06e00f46` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:17:02.328773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7e8359c0aa4334a9605aef06e00f46)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:17:02.329850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:17:02.329850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:17:02.329850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:17:02.331060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:17:02.395970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7e8359c0aa4334a9605aef06e00f46', 'request_id': 'req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:02.407079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7e8359c0aa4334a9605aef06e00f46', 'request_id': 'req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:02.424085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7e8359c0aa4334a9605aef06e00f46', 'request_id': 'req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:02.457299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] The token cache is being invalidate because project cd7e8359c0aa4334a9605aef06e00f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:17:02.457588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:02.458042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0881c287-c319-42e6-a5c6-f9b3e4de6ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:17:02.459438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 756/1510] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:17:02 2022] DELETE /identity/v3/projects/cd7e8359c0aa4334a9605aef06e00f46 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:17:11.822039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=62 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:17:12.455187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:40.309218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:40.309856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:40.309856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:40.311196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:40.316691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805368-9639-4f38-9a82-47f1fdff6cfc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:40.317186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805368-9639-4f38-9a82-47f1fdff6cfc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:40.317274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30805368-9639-4f38-9a82-47f1fdff6cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:40.402356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-30805368-9639-4f38-9a82-47f1fdff6cfc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:40.403577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-30805368-9639-4f38-9a82-47f1fdff6cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:40.510703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:40.662068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:40.664416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:40.789014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126ebc7-b69f-456f-b715-648fbc9c9908 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:40.795177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:40.795779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:40.796057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:40.796325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:40.804936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:40.806548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5bb668-4b68-4ac6-a079-c59c6a95dfca service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:40.816609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 756/1513] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:41.635500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c511-7828-41fb-a5a9-e40c2dd6a06d None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:41.636094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c511-7828-41fb-a5a9-e40c2dd6a06d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:41.636094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c511-7828-41fb-a5a9-e40c2dd6a06d None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:41.637426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:41.642723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdaab-6e03-471f-8efd-b3a76ea90672 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:41.643160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdaab-6e03-471f-8efd-b3a76ea90672 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:41.643272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cdaab-6e03-471f-8efd-b3a76ea90672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:41.664619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-af4cdaab-6e03-471f-8efd-b3a76ea90672 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:41.665861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-af4cdaab-6e03-471f-8efd-b3a76ea90672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:41.675756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:41.832642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c511-7828-41fb-a5a9-e40c2dd6a06d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:41.848588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626c511-7828-41fb-a5a9-e40c2dd6a06d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:41.854452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:41.855053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:41.855325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:41.855640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:41.864176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:41.865825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b1ff5-fbb3-4c67-bfe3-c97b966b4c16 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:41.875864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 759/1516] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:42.322892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e073-f00e-43ee-a0a7-7cb162d28dc3 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:42.323183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e073-f00e-43ee-a0a7-7cb162d28dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:42.323481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044e073-f00e-43ee-a0a7-7cb162d28dc3 None None] PATH_INFO: `/v3` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:42.324778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 758/1517] 10.222.0.78 () {54 vars in 925 bytes} [Sat Aug 27 02:18:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:18:42.330809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc120ff-8648-4697-a291-1b15c44bad03 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:42.331167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc120ff-8648-4697-a291-1b15c44bad03 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:42.331594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc120ff-8648-4697-a291-1b15c44bad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:42.406429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5dc120ff-8648-4697-a291-1b15c44bad03 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:42.407758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5dc120ff-8648-4697-a291-1b15c44bad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:42.426816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:18:42.487214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 760/1518] 10.222.0.78 () {58 vars in 1015 bytes} [Sat Aug 27 02:18:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:51.462302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f210-5e19-4234-94dc-442d7584ea76 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:51.462854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f210-5e19-4234-94dc-442d7584ea76 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:51.462854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f210-5e19-4234-94dc-442d7584ea76 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:51.464077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 759/1519] 10.222.0.61 () {54 vars in 961 bytes} [Sat Aug 27 02:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:51.469619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fa190-73b9-44a1-b6b6-3b4b306b8118 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:51.470071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fa190-73b9-44a1-b6b6-3b4b306b8118 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:51.470175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488fa190-73b9-44a1-b6b6-3b4b306b8118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:51.491450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-488fa190-73b9-44a1-b6b6-3b4b306b8118 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:51.492676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-488fa190-73b9-44a1-b6b6-3b4b306b8118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:51.502300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 761/1520] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Aug 27 02:18:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:51.510123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23f210-5e19-4234-94dc-442d7584ea76 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:51.525552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23f210-5e19-4234-94dc-442d7584ea76 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:51.531069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:51.531704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:51.531982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:51.532256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:51.541660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:51.543253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb58c8-6818-4192-86ec-019ddb1ea7a3 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:51.553738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 760/1521] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:53.142245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64635-59d3-4621-8b37-32a091422e2c None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:53.142706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64635-59d3-4621-8b37-32a091422e2c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:53.142811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c64635-59d3-4621-8b37-32a091422e2c None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:53.144534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:53.149801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5449ae-bbcf-4017-94a9-dcd1d03b8f3e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:53.150245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5449ae-bbcf-4017-94a9-dcd1d03b8f3e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:53.150336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5449ae-bbcf-4017-94a9-dcd1d03b8f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:53.170333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ca5449ae-bbcf-4017-94a9-dcd1d03b8f3e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:53.171540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ca5449ae-bbcf-4017-94a9-dcd1d03b8f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:53.180412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:53.334929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64635-59d3-4621-8b37-32a091422e2c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:53.350145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c64635-59d3-4621-8b37-32a091422e2c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:53.355904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:53.356505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:53.356777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:53.357044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:53.366059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:53.368096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f5a78-00da-44e5-846b-a8968dc9659d service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:53.378616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 763/1524] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:54.185222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939d6-f283-4e1f-bc8c-a30da012b7e8 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:54.186014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939d6-f283-4e1f-bc8c-a30da012b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:54.186014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939d6-f283-4e1f-bc8c-a30da012b7e8 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:54.187198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Aug 27 02:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:54.192450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4041-69c6-4ceb-9693-9311328ef1c4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:54.192916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4041-69c6-4ceb-9693-9311328ef1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:54.193017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f4041-69c6-4ceb-9693-9311328ef1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:54.212845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9e7f4041-69c6-4ceb-9693-9311328ef1c4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:54.214081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9e7f4041-69c6-4ceb-9693-9311328ef1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:54.222380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Aug 27 02:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:54.374970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f939d6-f283-4e1f-bc8c-a30da012b7e8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:54.389734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f939d6-f283-4e1f-bc8c-a30da012b7e8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:54.395308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:54.395911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:54.396191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:54.396465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:54.406286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:54.407895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0058ac-81db-4e70-8196-3babc1ab3e98 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:54.419635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 763/1527] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:18:58.319370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:58.319918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:58.319918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:58.321270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:18:58.328449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed0ee3-ff64-41b9-8722-39d3b605b541 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:58.328996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed0ee3-ff64-41b9-8722-39d3b605b541 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:58.329527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed0ee3-ff64-41b9-8722-39d3b605b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:58.358491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-65ed0ee3-ff64-41b9-8722-39d3b605b541 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:18:58.359711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-65ed0ee3-ff64-41b9-8722-39d3b605b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:58.368201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:18:58.662275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:18:58.664361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:18:58.754623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252341-4ada-478d-96d7-bd7daeb3d30b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:18:58.759084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:18:58.759865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:18:58.760218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:18:58.760556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:18:58.772565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:18:58.774127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80b80e-b14f-4422-8239-4afffaa074f2 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:18:58.785497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 766/1530] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:18:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:19:00.656932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984bd5-ac4a-465b-9853-de9e14dfc8db None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:00.657673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984bd5-ac4a-465b-9853-de9e14dfc8db None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:00.657673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79984bd5-ac4a-465b-9853-de9e14dfc8db None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:00.658835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:19:00.664334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc591-fa58-4922-9e7f-a8e33cf1ab1c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:00.664929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc591-fa58-4922-9e7f-a8e33cf1ab1c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:00.664929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bc591-fa58-4922-9e7f-a8e33cf1ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:00.685187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-160bc591-fa58-4922-9e7f-a8e33cf1ab1c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:19:00.686434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-160bc591-fa58-4922-9e7f-a8e33cf1ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:19:00.694979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:19:00.974461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984bd5-ac4a-465b-9853-de9e14dfc8db None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:19:00.986533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79984bd5-ac4a-465b-9853-de9e14dfc8db None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:19:00.990402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:19:00.991006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:00.991291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:00.991557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:01.002050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:19:01.003524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595abea2-9c4d-4386-b8a3-fe333c7c4a3b service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:19:01.014103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 766/1533] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:19:04.455650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:04.456327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:04.456327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:04.457678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:19:04.463090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e875ca-cb15-438d-9e28-b10b61d557e2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:04.463577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e875ca-cb15-438d-9e28-b10b61d557e2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:04.463577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e875ca-cb15-438d-9e28-b10b61d557e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:04.471488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=81 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:19:04.485698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-73e875ca-cb15-438d-9e28-b10b61d557e2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:19:04.487033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-73e875ca-cb15-438d-9e28-b10b61d557e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:19:04.495538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:19:05.036609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:19:05.038603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:19:05.110360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:19:05.124983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db61e550-7b53-45f3-83e8-bd1ca322fc3a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:19:05.129051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:19:05.129694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:05.129975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:05.130243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:05.140606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:19:05.142083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4826a1-cf6d-4959-b88b-dcf40047ca23 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:19:05.152213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 769/1536] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:19:07.089097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:07.089747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:07.089747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:07.091116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Aug 27 02:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:19:07.096654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab9d6-15e4-4329-ada2-1af17c916291 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:07.097178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab9d6-15e4-4329-ada2-1af17c916291 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:07.097178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ab9d6-15e4-4329-ada2-1af17c916291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:07.118082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cb8ab9d6-15e4-4329-ada2-1af17c916291 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:19:07.119276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cb8ab9d6-15e4-4329-ada2-1af17c916291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:19:07.128745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Aug 27 02:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:19:07.670537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:19:07.672622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:19:07.687559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c292160-ad46-4d46-b3d7-b8ff10b277f7 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:19:07.691667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:19:07.692269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:19:07.692550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:19:07.692822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:19:07.702705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:19:07.704151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aa21df-9b2a-4e8c-9c68-018aa35e3357 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:19:07.714018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 769/1539] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:19:17.112819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=11 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:19:17.709846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=8 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:34.045792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.046447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.046447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.074446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.075893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.088518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 771/1540] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.098117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3857-67ec-4d36-a193-0ebc8612657b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.098725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3857-67ec-4d36-a193-0ebc8612657b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.098725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb3857-67ec-4d36-a193-0ebc8612657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.129786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c4bb3857-67ec-4d36-a193-0ebc8612657b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.131472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c4bb3857-67ec-4d36-a193-0ebc8612657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.146144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 770/1541] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.151366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.161914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8ab8-73d6-40f2-92a1-304833779d1d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.164246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347599c1-2c89-4679-a72e-7710484dbd69 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.164767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347599c1-2c89-4679-a72e-7710484dbd69 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.165297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347599c1-2c89-4679-a72e-7710484dbd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.171825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.172477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.172756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.173028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.173729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:34.174017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.175634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.193705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 772/1542] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:34.202044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.204742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-347599c1-2c89-4679-a72e-7710484dbd69 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.206208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-347599c1-2c89-4679-a72e-7710484dbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.215751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23b96-5474-4d5e-ae36-55ff8eda4249 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.222934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 771/1543] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:20:34.225179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.225853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.226130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.226403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.227047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.228105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:34.228105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:20:34.228105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:20:34.229322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7e06c-0930-46de-96f3-255c87a2f1af admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.232489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.233058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.233579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.271764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.273980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.291350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 773/1544] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:20:34.292045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 772/1545] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.292710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.293001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.293274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.296911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.314290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9effcc4-ebad-4364-b9b5-6386e3fabbfa None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.326236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.327452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.416625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 774/1546] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.417506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.431115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.431753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.432034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.432304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.432966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:34.433267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.434323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:34.434323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:20:34.434323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:20:34.435226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89221002-a70c-4d97-ad9d-dfc78c949416 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.441813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9eaeb4-fcdf-4b35-999b-30bd411ed895 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.460854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.461522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.461845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.462089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.462724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.464754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c427c71-0673-4b55-9502-71c7720bd791 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.472030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 773/1547] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:34.473345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104422-0970-451c-8a42-ee24f5117565 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.473663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104422-0970-451c-8a42-ee24f5117565 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.473935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95104422-0970-451c-8a42-ee24f5117565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.514886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 775/1548] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:34.516323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.516598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.516870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.535615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-95104422-0970-451c-8a42-ee24f5117565 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.536867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-95104422-0970-451c-8a42-ee24f5117565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.560220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 774/1549] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.560970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104422-0970-451c-8a42-ee24f5117565 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.572554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.575421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.581859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95104422-0970-451c-8a42-ee24f5117565 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.595353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.595990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.596279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.596551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.597204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.599524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 776/1550] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.599836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551ec50e-cd0b-46bd-8747-00c0d83d991f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.600139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.622318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d837639-f26b-4ce5-9902-181a9f4adbe3 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.634599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.635337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.635669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.635860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.636478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.638201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.655524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 775/1551] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:34.656869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.657153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.657446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.658123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 777/1552] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:34.658941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.677088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650764bd-71d7-40cf-ad84-b69dbc2b3807 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.694647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.696474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.765880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.766527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.767124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.767414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.768396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:34.768703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.770724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.775166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 776/1553] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.775959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.786075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80c638-3a74-455d-8363-3b506050a336 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.787085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 778/1554] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:34.788274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.793465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.794624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.795004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.795387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.796121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.798234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e03b9-9ce5-4be4-aedf-065cead812e8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.799535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48331360-c352-4198-9ae7-cd593d44d87a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.805245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.805892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.806177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.806448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.807087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.809572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4145bc53-197f-4309-ac5b-19d1d22e9904 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.809963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 777/1555] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:34.813905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4cdc-24e5-49af-bc0b-2023823d5026 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.814481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4cdc-24e5-49af-bc0b-2023823d5026 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.815371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e4cdc-24e5-49af-bc0b-2023823d5026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.819459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:34.840879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 779/1556] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:34.840879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.840879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.840879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.850370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-824e4cdc-24e5-49af-bc0b-2023823d5026 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.851700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-824e4cdc-24e5-49af-bc0b-2023823d5026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.860305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 778/1557] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.861248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.861571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.861972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.867076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.868286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.885429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 780/1558] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.885429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.886918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:34.888318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:34.896554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280e043-c0d2-4a89-af50-7ee8f988a7b6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.901338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.901987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.902267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.902680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.903337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:34.903665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.904709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 779/1559] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:34.905701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.905827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.915318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa234508-94bd-4c0f-88c6-4514ccb48692 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.920029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 781/1560] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:34.920833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.927537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.928311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.928605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.928881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.929563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.931500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.933338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c13cc-4d02-4b57-a88f-5364d14c9afb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:34.938738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:34.939428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.939833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.940111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] PATH_INFO: `/v3/projects/798006e2950748d385992c337ad16ee6/users/42b5a5c61c594ea2a1bd1f3fe91fd2e2/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:34.958208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=798006e2950748d385992c337ad16ee6, user_id=42b5a5c61c594ea2a1bd1f3fe91fd2e2, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:34.959385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:34.959385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:20:34.959385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:20:34.960721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:34.961356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d5a3e-cb66-4154-9502-144fa4c949ce admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:34.968503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 780/1561] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:34.969766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:34.983785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 782/1562] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:34 2022] PUT /identity/v3/projects/798006e2950748d385992c337ad16ee6/users/42b5a5c61c594ea2a1bd1f3fe91fd2e2/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:34.985981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247d3df-2cd0-4ed6-8c5f-94e81993ef21 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:34.986886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247d3df-2cd0-4ed6-8c5f-94e81993ef21 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:34.987444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247d3df-2cd0-4ed6-8c5f-94e81993ef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.015479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8247d3df-2cd0-4ed6-8c5f-94e81993ef21 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.016740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8247d3df-2cd0-4ed6-8c5f-94e81993ef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.047395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d306e-7641-4f21-80b9-dd101281b4aa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.078696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 783/1563] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.080216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f72d7-4ea2-48b0-a126-61c8262c2825 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.080500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f72d7-4ea2-48b0-a126-61c8262c2825 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.080769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f72d7-4ea2-48b0-a126-61c8262c2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.099766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a40f72d7-4ea2-48b0-a126-61c8262c2825 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.100952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a40f72d7-4ea2-48b0-a126-61c8262c2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.113329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 784/1564] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.113538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.113538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.114116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4704-e465-4cfe-91d3-4cf20b823996 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.114218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.114326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4704-e465-4cfe-91d3-4cf20b823996 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.114421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.114496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4704-e465-4cfe-91d3-4cf20b823996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.114577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.114577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.127275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 781/1565] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.127275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.132113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-73bb4704-e465-4cfe-91d3-4cf20b823996 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.133266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-73bb4704-e465-4cfe-91d3-4cf20b823996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.136566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdb871-debf-419d-a8ec-2bcb1cb57e78 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.141635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.142252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.142524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.142801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.143606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 785/1566] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.143725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.144655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.144935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.145259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.145709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069f2d1-2045-4c4c-b1ac-e58c860e83aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.164947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.166230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.174805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 786/1567] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.175018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 782/1568] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.175425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.179449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.179752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.180343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.185961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13154d26-e0f6-4e64-9b24-a20071b940de None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.212198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] MFA Rules not processed for user `42b5a5c61c594ea2a1bd1f3fe91fd2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.213455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.246066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.246664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.246937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.247204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.247834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.249791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.272713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 787/1569] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.273689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.281170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 783/1570] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.282059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.283968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad797df3-1778-4c45-97fa-2565ff20b656 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.289214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.290117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.290395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.290663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.291307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:35.291605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.292707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67db53-fb6b-423b-9812-7a356084bd8b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.293281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.298143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.298773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.299052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.299351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.300474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:35.300790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.302933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.306192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 788/1571] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:35.307004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.310414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:35.324929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 784/1572] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:35.325176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:35.325176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14eecc-a748-4bcf-9d14-535178071de1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.326961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.331937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.332485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.332760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.333032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.333885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.335592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.339427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228c676-cbc4-4a14-92c7-d7fad7cfa5b4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.345044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.345699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.345979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.346306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.346911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:35.347214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.348823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 789/1573] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.349109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01574fce-11b4-48a8-8bf1-910df0ec5e6a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.349686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.360077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbae0d9-57f8-4d8d-9f8e-7f420ee4fd3e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.369314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 785/1574] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:35.369314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.369314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.369314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.370081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.370081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.370081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.370081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.370472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.370472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.387637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.388942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.393780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 790/1575] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 302 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.394773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.404007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 786/1576] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.404007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.404665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d44b9c-430d-4919-9b71-7dbf60641d44 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.409492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.410094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.410404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.410673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.410823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6092f1e-4702-4d00-b2d8-57be1c3e9a88 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.411341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.412939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.415400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.416011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.416286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.416586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.417225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.419165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.425551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 791/1577] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.426546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.438541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d7df8-5116-4069-9755-91e47b15910d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.444058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.444717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.444997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.445272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.445950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.447942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.449028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 787/1578] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 403 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.449930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.478355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 792/1579] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.479221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.514489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3771e6-d040-409d-8a3e-cc016c67b868 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.546816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84af096-4560-463e-ad54-28ff9ef5a06d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.551896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.552566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.552845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.553178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] PATH_INFO: `/v3/projects/67209b74f2fa4ae7ad9762d141378a5d/users/1eb664209056410d890d1b2b8bfa0155/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.567702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67209b74f2fa4ae7ad9762d141378a5d, user_id=1eb664209056410d890d1b2b8bfa0155, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.570425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.572242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.572864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.573142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.573744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.574067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.576273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.584414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 793/1580] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:35 2022] PUT /identity/v3/projects/67209b74f2fa4ae7ad9762d141378a5d/users/1eb664209056410d890d1b2b8bfa0155/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:35.588738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.605053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 788/1581] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.609264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.661976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:35.664811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0f779-cc07-49e6-86a7-e8c475781599 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.676191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29735565-893c-4cd3-be19-61dcb65287d4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.680882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.681631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.681955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.682312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.682963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.684591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.694771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 789/1582] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.695668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.700041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:35.706313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734a870-3fa9-419f-ad0c-2d2c7c44da0c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.710965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.711561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.711834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.712105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.712742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:35.713039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.714770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.727104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 790/1583] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:35.728128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.728901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.729547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.729826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.730099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.730731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.732646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.743828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269169f-940b-4dbd-bdcf-a9c5b1e3bf0a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.748736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.749553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.749944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.750285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.751059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.752902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.760799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 794/1584] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.761690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.763518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 791/1585] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.764415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.774913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499646-9498-4f5e-8b17-7667d907580d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.830446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13027-6ac0-47e8-9423-4be3e97bc81b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.830977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.831596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.831875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.832153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.832793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.833866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:35.833866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:20:35.833866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:20:35.835142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255c03b-04a6-4a74-b5ba-6776d09c004e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.835448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.836077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.836347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.836609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.837238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.839167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.860579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 792/1586] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.860965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 795/1587] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 308 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.861905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.862896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.863327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.863791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.871467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502efacd-c310-457c-af3e-9af2fb573d45 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.876071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.876655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.876929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.877200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.877848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.879767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.883571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:35.884761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:35.893627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 793/1588] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:35.896953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.904767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbe617-1b6e-4dc7-9c65-283e9c33f9b4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.906178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 796/1589] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.909985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.910151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.910616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.910892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.911160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.911801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.913455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.920032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d56470-0b94-4f80-871f-07a91913abcd admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.923832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 794/1590] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:35.924449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.928459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.929163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.929468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.929766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.930414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.932387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.934076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170393b2-d8ca-43c7-bb54-7bb5562b74ac admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:35.938978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:35.939628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:35.939975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:35.940310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:35.941026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:35.943070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:35.963769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 797/1591] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.964752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.968483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 795/1592] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:35 2022] POST /identity/v3/users => generated 294 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:35.969630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:35.979218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7eadbd-bfcd-4825-83e7-1dd3c6a08e75 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.029979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4722f2-873a-4a17-aacc-b8d473c21acb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.034793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.035449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.035725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.035834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.035996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] PATH_INFO: `/v3/projects/8aa1c411b57d4e72885dac2b4f4dfe7a/users/4a6f819365574091ae344f14e47f487f/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.036414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.036693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.036964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.037666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.039332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.048868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.054555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 796/1593] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.054727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa1c411b57d4e72885dac2b4f4dfe7a, user_id=4a6f819365574091ae344f14e47f487f, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.054827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.055267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.068139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a5bd-16d9-4de6-b3ed-28796ff84ec5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.073896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 798/1594] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:35 2022] PUT /identity/v3/projects/8aa1c411b57d4e72885dac2b4f4dfe7a/users/4a6f819365574091ae344f14e47f487f/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.073896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.079209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.125764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9185f57-2f06-4ecf-a924-6caeda33bf79 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.129878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.130548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.130770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.131039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.144006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.144891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.145259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.145660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.146426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.148105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.158664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 797/1595] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.159814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.171236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e542005-0d84-4d84-ab86-413eb6cab260 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.176595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.177373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.177696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.178023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.178703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.180330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.193148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 798/1596] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.194174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.200068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.201686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.204973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d6445-2ad4-4afb-afd6-44215b76d60d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.210976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.211990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.212450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.213076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] PATH_INFO: `/v3/projects/09b43d76207c40a8a5d7c6d1fb3564d1/users/c71dd94e52604191ba726a8b45b5f6b0/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.213217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 799/1597] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:36.213882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.223892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f3289-7f52-49c6-8fc7-463484034d2f service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.228943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.229763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.230036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.230309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.230954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.232599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b43d76207c40a8a5d7c6d1fb3564d1, user_id=c71dd94e52604191ba726a8b45b5f6b0, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.233035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.235781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.251765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 799/1598] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:36 2022] PUT /identity/v3/projects/09b43d76207c40a8a5d7c6d1fb3564d1/users/c71dd94e52604191ba726a8b45b5f6b0/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.252464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.265674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 800/1599] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:36 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:36.265674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.277912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844269a8-ed06-407d-b863-fced3534e75d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.329465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020d92e-406b-43e7-95ca-14dfc8bcbc08 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.335130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.335834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.336323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.336480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.337013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.339361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8837d-21a0-4ea9-b15b-c7ae16ee048b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.345219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.345951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.346297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.346627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.347332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.349028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.351278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 800/1600] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.355444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.355623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.356034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.361643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 801/1601] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.362445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.373875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374ce96-25c7-4499-b8d6-55484dbda5b9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.376441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:36.377734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:36.380499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.381251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.381794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.382141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] PATH_INFO: `/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13/users/1a96fa3e04f846b0a27e484619b726dc/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.385869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 801/1602] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:36.386491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.396337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707235f-9f8c-4a51-820e-ff06f548a87e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.401507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.402126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.402400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.402667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.403303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.403720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3684b1a7ff409ba8e3297d895e2f13, user_id=1a96fa3e04f846b0a27e484619b726dc, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.406037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77fcd2-e14c-4948-93db-55ac65eaa07a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.406733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.411260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.421675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 802/1603] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.426272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.426272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.426272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.439677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 802/1604] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:36 2022] PUT /identity/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13/users/1a96fa3e04f846b0a27e484619b726dc/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.439677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.460523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:36.461806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:36.514644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.522778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff012-dee4-4c12-aa0c-4b5b9b9ac315 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.528333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.529009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.529363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.529729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.530567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.534645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 803/1605] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:36.534804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.534902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.548617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 803/1606] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.549610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.550530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902291a-b6c3-4436-bd33-a5f6882401be None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.555533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.556379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.556741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.557017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.557736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.559387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.561045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcda839-df02-4f35-a35c-c48c62d6f207 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.566103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.566976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.567416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.567849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] PATH_INFO: `/v3/projects/a8ea92846cdc41e88962eecb4337401d/users/d08561462e074ac4af888fa855dd64ae/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.569956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 804/1607] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.570837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.572526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:36.608389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea92846cdc41e88962eecb4337401d, user_id=d08561462e074ac4af888fa855dd64ae, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.611707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.629539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 804/1608] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:36 2022] PUT /identity/v3/projects/a8ea92846cdc41e88962eecb4337401d/users/d08561462e074ac4af888fa855dd64ae/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.630494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.644925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c18d-4b27-4108-a92a-0d53fc7e1e42 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.700991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.701807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.702095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.702499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.724191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0d48c-20c7-4338-97f1-ca1ddf2900a0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.731785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.732446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.732927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.733076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] PATH_INFO: `/v3/projects/b29ac730884f411b91b8cb922f7b0bea/users/8fcf84d1b6d04255b62ab22d35e80280/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.754141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b29ac730884f411b91b8cb922f7b0bea, user_id=8fcf84d1b6d04255b62ab22d35e80280, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.757434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.774935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 805/1609] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:36 2022] PUT /identity/v3/projects/b29ac730884f411b91b8cb922f7b0bea/users/8fcf84d1b6d04255b62ab22d35e80280/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.775980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.782093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.784224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.795458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 805/1610] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:36.796272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.806062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5150d8-9320-4704-ae36-ed346b5d3c29 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.838224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.855580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51267a68-cec1-4439-a114-b366ce47ef1a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.861157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.861892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.862216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.862519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.862728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:36.863395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.865761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.869832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.870552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.870779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.871161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.881876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 806/1611] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.881876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.886455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.887924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.892658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aecb029-9aae-4a58-abf5-28e1260ab34e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.897836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.898509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.899064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.899206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 806/1612] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:36.899313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.899797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:36.899913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.901705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18136-0d15-4536-a5b4-17d9005c5e94 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.909430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d29bcb-f93d-4ce4-a231-ada4b5cd93a2 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:36.913818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 807/1613] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:36.915493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.916355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.916355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.917996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:36.918706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.918990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.919265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] PATH_INFO: `/v3/projects/9409824440cb45508754064b55438edd/users/cd08f3b52004476b9eb532c7c68ab679/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.936041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9409824440cb45508754064b55438edd, user_id=cd08f3b52004476b9eb532c7c68ab679, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:36.938789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af5148-9302-452d-8218-ce7ae8a14205 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:36.948595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] MFA Rules not processed for user `d08561462e074ac4af888fa855dd64ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:36.950384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:36.955135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 807/1614] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:36 2022] PUT /identity/v3/projects/9409824440cb45508754064b55438edd/users/cd08f3b52004476b9eb532c7c68ab679/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:36.960622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:36.960981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:36.961340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:36.984025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:36.985197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:37.042888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 808/1615] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:37.049248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.091260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 808/1616] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:37.092674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.112845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753e8f3-469b-4b68-a0c1-29424e742ce5 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.119773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.120872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.121447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.121946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] PATH_INFO: `/v3/projects/782d9d02db5c49fda33321f2914a7f31/users/22fbea2c71674b239e6d8fba6518e962/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.126637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb790-88e0-4ac1-a38a-7feac8e5f1c0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.131519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.132253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.132513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.132788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] PATH_INFO: `/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13/users/1a96fa3e04f846b0a27e484619b726dc/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.135066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3684b1a7ff409ba8e3297d895e2f13, user_id=1a96fa3e04f846b0a27e484619b726dc, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.137857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebe5e1-f6a5-4b2b-9d80-c4a37c5d027a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.141260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782d9d02db5c49fda33321f2914a7f31, user_id=22fbea2c71674b239e6d8fba6518e962, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.144691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.150229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 809/1617] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:37 2022] PUT /identity/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13/users/1a96fa3e04f846b0a27e484619b726dc/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:37.160426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.160834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.162034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.169618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 809/1618] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:37 2022] PUT /identity/v3/projects/782d9d02db5c49fda33321f2914a7f31/users/22fbea2c71674b239e6d8fba6518e962/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:37.174561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.188605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:37.190190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:37.257965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:37.271418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 810/1619] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:37.272692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.307952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f0ab8-c4e0-40fc-9bf2-203c6fd1fbb2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.321848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.322585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.322879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.323165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.355060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef84cf5-6fe4-48bd-87a3-5b5427ad2fab None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.361942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.362198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.362465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.362734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.373208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.374758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c0b10-582a-482e-b74c-ff5adad2ef7e service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.386196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 811/1620] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:37.387659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.387951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.388223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.421466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] MFA Rules not processed for user `1a96fa3e04f846b0a27e484619b726dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:37.423149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:37.452194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:37.464892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.466599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59142e24-e946-4169-960d-553d4c90a391 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.491992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 810/1621] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:37.493694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.497848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.498958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.528947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 812/1622] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:37.529991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.542145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20167e69-5493-4a98-8e7b-ca25043626f8 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.546834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.547468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.547844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.548110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.558925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.560556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.567270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:37.568520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:37.571752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 813/1623] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:37.572906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.586314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f93116-6991-4851-a879-84f7ec9e1ff1 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.586858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.587587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.587859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.588126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.599503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.601088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.610283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 811/1624] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:37.614563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 814/1625] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:37.630955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.645269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe40e4f-38a2-413b-a074-e5050754fc65 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.653207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.653892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.654175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.655058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.679346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.680922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ff80c-4f76-4e87-941c-67cef2cd4a4e service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:37.702270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 812/1626] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:37.916991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:37.938847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a19a4f-269f-4cb2-9ff0-df6c3205b156 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:37.955369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:37.958011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:37.960888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:37.961336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] PATH_INFO: `/v3/users/42b5a5c61c594ea2a1bd1f3fe91fd2e2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:37.964173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b5a5c61c594ea2a1bd1f3fe91fd2e2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:37.965422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: WARNING py.warnings [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:37.965422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: warnings.warn(msg) Aug 27 02:20:37.965422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: Aug 27 02:20:37.967381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:38.119755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b5a5c61c594ea2a1bd1f3fe91fd2e2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:38.149283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:38.161522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b5a5c61c594ea2a1bd1f3fe91fd2e2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:38.162467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b5a5c61c594ea2a1bd1f3fe91fd2e2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:38.188552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b5a5c61c594ea2a1bd1f3fe91fd2e2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:38.189514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b5a5c61c594ea2a1bd1f3fe91fd2e2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:38.224000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 815/1627] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:20:37 2022] DELETE /identity/v3/users/42b5a5c61c594ea2a1bd1f3fe91fd2e2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:38.228582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5529-3778-4d18-a081-ae20bde14863 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:38.229124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5529-3778-4d18-a081-ae20bde14863 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:38.229124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5529-3778-4d18-a081-ae20bde14863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:38.256298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cf7e5529-3778-4d18-a081-ae20bde14863 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:38.269920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cf7e5529-3778-4d18-a081-ae20bde14863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:38.438802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 813/1628] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:38.510363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:38.511872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:38.710563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6352edb-dd43-4a7b-817f-052784bd99ba admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:38.710563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:38.710563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:38.710563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:38.711087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:38.711087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:38.715711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd67dc-6a53-4f8f-97ec-958deb446b8d service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:38.763430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 816/1629] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:39.998135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:39.999577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.000017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.002086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 814/1630] 10.222.0.61 () {54 vars in 962 bytes} [Sat Aug 27 02:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:40.017749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9375-1946-47f8-b548-5f1ae238f421 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.018638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9375-1946-47f8-b548-5f1ae238f421 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.018638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9375-1946-47f8-b548-5f1ae238f421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.124390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:40.126270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.133448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-aadb9375-1946-47f8-b548-5f1ae238f421 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:40.134779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-aadb9375-1946-47f8-b548-5f1ae238f421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.154812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d6e07-31b3-4c6b-b133-a139f907f6c4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:40.168442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:40.169373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.169860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.170262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] PATH_INFO: `/v3/projects/798006e2950748d385992c337ad16ee6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.174411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=798006e2950748d385992c337ad16ee6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:40.176212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: WARNING py.warnings [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 27 02:20:40.176212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: warnings.warn(msg) Aug 27 02:20:40.176212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: Aug 27 02:20:40.177794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:40.222641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 817/1631] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Aug 27 02:20:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:40.229214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf488a-7639-4f2e-a56b-708d64056f8e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.229677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf488a-7639-4f2e-a56b-708d64056f8e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.230026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf488a-7639-4f2e-a56b-708d64056f8e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.232578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 818/1632] 10.222.0.61 () {54 vars in 912 bytes} [Sat Aug 27 02:20:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:40.238144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.238513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.239777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.268774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:40.271120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.292974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 819/1633] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:20:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:40.309080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:40.313971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.351343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '798006e2950748d385992c337ad16ee6', 'request_id': 'req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.374854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '798006e2950748d385992c337ad16ee6', 'request_id': 'req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.422761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '798006e2950748d385992c337ad16ee6', 'request_id': 'req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.446277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] The token cache is being invalidate because project 798006e2950748d385992c337ad16ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:20:40.447573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.449070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.455358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 815/1634] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:20:40 2022] DELETE /identity/v3/projects/798006e2950748d385992c337ad16ee6 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:40.460163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:40.462624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.494487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:40.505321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8e3c6-7f16-40c6-9363-09c714e51f46 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:40.672851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0e1b4-e372-4e6b-aa55-3a435e1d2314 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:40.678816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:40.682448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.683113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.684040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.688753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:40.704722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.704722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.705181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:40.707730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] PATH_INFO: `/v3/users/1a96fa3e04f846b0a27e484619b726dc` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.708824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a96fa3e04f846b0a27e484619b726dc)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:40.712273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:40.718658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:40.819439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a96fa3e04f846b0a27e484619b726dc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.829697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a96fa3e04f846b0a27e484619b726dc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.844948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a96fa3e04f846b0a27e484619b726dc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.845896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a96fa3e04f846b0a27e484619b726dc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.855720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fcf68803-c47a-457a-a7fa-8658211f52fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a96fa3e04f846b0a27e484619b726dc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:40.864496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 816/1635] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:20:40 2022] DELETE /identity/v3/users/1a96fa3e04f846b0a27e484619b726dc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:20:40.866292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:40.866759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:40.868273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:40.877601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:40.879017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:40.899703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 820/1636] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:20:40.922831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] MFA Rules not processed for user `c71dd94e52604191ba726a8b45b5f6b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:40.924391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:41.041839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 817/1637] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:41.046957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:41.048642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:41.070566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97423e8b-c853-4e66-855a-0946758fdb02 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:41.176280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:41.176634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:41.177910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:41.178841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:41.181736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:41.184886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:41.277091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 821/1638] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:41 2022] POST /identity/v3/projects => generated 403 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:20:41.280434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:41.282884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:41.385566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e01538-ce3e-4432-abb3-a76fec37048e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:41.574475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:41.575947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:41.576269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:41.576635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:41.577831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:41.580923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:41.620732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:41.633951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 818/1639] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:41 2022] POST /identity/v3/users => generated 308 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:41.638001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:41.656711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02ba50-974f-4e3d-8c76-17f96f542ede admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:41.672403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:41.676983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:41.677273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:41.677579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:41.678264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:41.679917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:41.715978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 822/1640] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:41.719972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:41.759450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f5b8-e841-4602-8040-0b13cd016949 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:41.785706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:41.787680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:41.788378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:41.788665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] PATH_INFO: `/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c/users/de8949948bf44f5294bc74835993eeea/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:41.834330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66abb0e122da49f1bdcb95ed5a830c7c, user_id=de8949948bf44f5294bc74835993eeea, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:41.837081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:41.860571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 819/1641] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:41 2022] PUT /identity/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c/users/de8949948bf44f5294bc74835993eeea/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:41.865034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:41.883672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235690-b206-4686-b23a-9622ebe71fe1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:41.927925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:42.018244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:42.019628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:42.019628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:42.019841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:42.020785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:42.022722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:42.043335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 823/1642] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:42.047425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:42.059404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4de717-ec9c-4143-bb3c-e62b98b8127f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:42.066363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:42.067508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:42.067972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:42.068464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] PATH_INFO: `/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c/users/de8949948bf44f5294bc74835993eeea/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:42.070977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66abb0e122da49f1bdcb95ed5a830c7c, user_id=de8949948bf44f5294bc74835993eeea, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:42.074021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a14ba-388e-4d13-94e7-1e8c22b0a3e7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:42.090658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 820/1643] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:42 2022] PUT /identity/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c/users/de8949948bf44f5294bc74835993eeea/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:42.360250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:42.362065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:42.388160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cbdf1-4478-46f2-b2d7-1cfb82dc3eca admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:42.561362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:42.562105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:42.573795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:42.574197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] PATH_INFO: `/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:42.584989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3684b1a7ff409ba8e3297d895e2f13)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:42.593947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:42.680126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3684b1a7ff409ba8e3297d895e2f13', 'request_id': 'req-5be6daf3-b123-41d6-9b7f-c4b000fa9126'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:42.703289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3684b1a7ff409ba8e3297d895e2f13', 'request_id': 'req-5be6daf3-b123-41d6-9b7f-c4b000fa9126'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:42.718896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3684b1a7ff409ba8e3297d895e2f13', 'request_id': 'req-5be6daf3-b123-41d6-9b7f-c4b000fa9126'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:42.748485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] The token cache is being invalidate because project 6f3684b1a7ff409ba8e3297d895e2f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:20:42.749327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:42.750721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5be6daf3-b123-41d6-9b7f-c4b000fa9126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:42.757141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 824/1644] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:20:42 2022] DELETE /identity/v3/projects/6f3684b1a7ff409ba8e3297d895e2f13 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:42.759698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:42.760030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:42.760358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:42.799987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:42.802422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:42.965261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 821/1645] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:42.975295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:42.975442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:42.975627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.013488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:43.017137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:43.036446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 825/1646] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:43.041111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.064044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b272943-4fc3-4c41-9bd2-3809c5859fb3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.076075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.076717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.076999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.077271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.078001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:43.078305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.085341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.136821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 822/1647] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:43.141377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.156395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949a234-9666-4887-9377-83ac7b2a76fe None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.168320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.169502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.170011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.170472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.171373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.176014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21a177-279a-4fe8-bfff-d2fd9927e1ed admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.279933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 826/1648] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:43 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:20:43.285565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.297149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0116-d56d-4215-ba42-9be578a6dd41 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.297149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0116-d56d-4215-ba42-9be578a6dd41 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.297525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e0116-d56d-4215-ba42-9be578a6dd41 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.308300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 827/1649] 10.222.0.61 () {54 vars in 962 bytes} [Sat Aug 27 02:20:43 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:43.309670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189497-cd43-473d-8213-08916fe7a544 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.354408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b760-ba0e-4fde-8544-be90f2dfc727 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.354976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b760-ba0e-4fde-8544-be90f2dfc727 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.355510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b760-ba0e-4fde-8544-be90f2dfc727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.401104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4547b760-ba0e-4fde-8544-be90f2dfc727 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:43.423966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4547b760-ba0e-4fde-8544-be90f2dfc727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:43.469086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:43.514777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.515491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.515775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.516050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.516720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.519045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.555314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 823/1650] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:43 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:20:43.559968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.578865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9f9e-cdce-4614-aabe-a1b4ffc431dd admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.590887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.591522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.591950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.592280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.593189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.595551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.595821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 828/1651] 10.222.0.61 () {58 vars in 1059 bytes} [Sat Aug 27 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:43.610913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 824/1652] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:20:43.612076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573da5-17dd-49d6-afa8-983e676b707f None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.613771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573da5-17dd-49d6-afa8-983e676b707f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.614131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30573da5-17dd-49d6-afa8-983e676b707f None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.616376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.618293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 829/1653] 10.222.0.61 () {54 vars in 912 bytes} [Sat Aug 27 02:20:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:43.630404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.631255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.631717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.634082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8906cb-5b1e-4100-a6fa-eb0492078877 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.649593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.651032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.651882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.652907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.654306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.659007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.688244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 825/1654] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:43.690631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.696154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:43.697732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:43.713011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 830/1655] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:43.719597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c376977-606c-443e-93e2-391f9d6eb113 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.728283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:43.730384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:43.731193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.732045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.732512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.732946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] PATH_INFO: `/v3/projects/5dd26cff8b984d66b04f58a2fe164a6e/users/b12c29b8ad4547bba488a8d24335702c/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.760144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:43.764124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd26cff8b984d66b04f58a2fe164a6e, user_id=b12c29b8ad4547bba488a8d24335702c, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:43.769557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40268669-4d1a-4f94-98c9-f7a603beab1e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:43.795481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 826/1656] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:43 2022] PUT /identity/v3/projects/5dd26cff8b984d66b04f58a2fe164a6e/users/b12c29b8ad4547bba488a8d24335702c/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:43.806188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.806618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.806993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:43.832495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c9aa2-d07e-43a0-9af2-486f916e5411 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:43.871892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] MFA Rules not processed for user `b12c29b8ad4547bba488a8d24335702c`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:43.873304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:43.955526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:43.957630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:43.958148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:43.958425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.010089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 827/1657] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:44.014765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.128063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.130098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.138001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:44.160262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0fc2-8757-4a67-8fe1-995d5923fac3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.165015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 831/1658] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:20:44.165350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.166177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.166722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.167109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.167873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.172824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.223642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 828/1659] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:44 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:44.226523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.252541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651c20b-9b93-4ea0-bc56-fc1a39703204 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.403539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.404316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.404693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.405084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.406548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.408232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.460547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 832/1660] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:44 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:44.466269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.481315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb0be6-51d2-4cb1-867b-35809d17b74e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.498706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.500296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.501311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.502453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.505023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.511499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.561432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.563647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 829/1661] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:44.580624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfd478-b7d7-4ee6-beca-2d7dcb4efa74 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.591994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.592783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.598034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.599162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] PATH_INFO: `/v3/projects/03a2849003724c5f9767aba8b009f988/users/f6f2607eef4a48058457a26ef72383df/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.641171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a2849003724c5f9767aba8b009f988, user_id=f6f2607eef4a48058457a26ef72383df, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.647592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.681577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 833/1662] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:44 2022] PUT /identity/v3/projects/03a2849003724c5f9767aba8b009f988/users/f6f2607eef4a48058457a26ef72383df/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:44.683370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.701722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22580cc4-d36b-41e2-b375-dbeb9a192617 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.846359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:44.855859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.857150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.858772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.859651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.861104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.867422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0378c2-ebea-453d-ae19-a9be82b7e832 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.896623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 830/1663] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:44.898065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:44.909941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61c13e-a1b3-47af-9528-8c60feb5c4b4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:44.915122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:44.918284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.918782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.919217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] PATH_INFO: `/v3/projects/03a2849003724c5f9767aba8b009f988/users/f6f2607eef4a48058457a26ef72383df/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.921606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a2849003724c5f9767aba8b009f988, user_id=f6f2607eef4a48058457a26ef72383df, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:44.924855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:44.952475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b1c-ae3b-4bc0-b47e-599c3eac3134 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:44.952907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b1c-ae3b-4bc0-b47e-599c3eac3134 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:44.953256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b1c-ae3b-4bc0-b47e-599c3eac3134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:44.953510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 834/1664] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:44 2022] PUT /identity/v3/projects/03a2849003724c5f9767aba8b009f988/users/f6f2607eef4a48058457a26ef72383df/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:45.013816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-45930b1c-ae3b-4bc0-b47e-599c3eac3134 None None] MFA Rules not processed for user `f6f2607eef4a48058457a26ef72383df`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:45.015526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-45930b1c-ae3b-4bc0-b47e-599c3eac3134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:45.193479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 831/1665] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:45.196434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:45.202679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:45.358707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703456f-06bf-4399-b6d8-a772cadda46f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:45.363591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:45.364018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:45.365790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:45.366170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:45.495163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:45.496595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:45.512398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 835/1666] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:46.156950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7d8a-c1fe-4ee1-838f-a474882ab39b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:46.157487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7d8a-c1fe-4ee1-838f-a474882ab39b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:46.157912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a7d8a-c1fe-4ee1-838f-a474882ab39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:46.283264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-687a7d8a-c1fe-4ee1-838f-a474882ab39b None None] MFA Rules not processed for user `de8949948bf44f5294bc74835993eeea`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:46.284530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-687a7d8a-c1fe-4ee1-838f-a474882ab39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:46.684420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 832/1667] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:46 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:49.084527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:49.105766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b1c66-66d6-443a-9be7-450beab68fbf service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:49.121224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:49.122175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:49.122594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:49.123172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:49.135233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:49.143667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:49.152073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f33c3c-2a35-49d4-b354-934575ffd161 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:49.191125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 836/1668] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:49.946596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:49.948032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:49.948591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:49.951080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 833/1669] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:20:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:50.013475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab77e-bd40-41b8-a711-952aea5d9f96 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:50.014957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab77e-bd40-41b8-a711-952aea5d9f96 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:50.016586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab77e-bd40-41b8-a711-952aea5d9f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:50.072740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c35ab77e-bd40-41b8-a711-952aea5d9f96 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:50.077140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c35ab77e-bd40-41b8-a711-952aea5d9f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:50.270448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 837/1670] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:20:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:50.293050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:50.296110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:50.302724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:50.302906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:50.303191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:50.358622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417b2b6-99b4-4eb5-b1e6-37aa2511db33 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:50.376561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:50.381589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:50.383178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:50.383645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:50.396239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:50.399171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ae564-4c65-4b4c-b663-72ccb551fb43 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:50.404252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] MFA Rules not processed for user `1eb664209056410d890d1b2b8bfa0155`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:50.408820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:50.447099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 834/1671] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:20:50.543583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 838/1672] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:50.553865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d14b-c172-4e2f-9fab-42201acaac7c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:50.554302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d14b-c172-4e2f-9fab-42201acaac7c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:50.554685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930d14b-c172-4e2f-9fab-42201acaac7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:50.586890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e930d14b-c172-4e2f-9fab-42201acaac7c None None] MFA Rules not processed for user `1eb664209056410d890d1b2b8bfa0155`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:50.588561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e930d14b-c172-4e2f-9fab-42201acaac7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:50.599305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 835/1673] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:50.612981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:50.744582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740ab5e-693b-43ef-b491-9a77fb7c9d44 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:50.753743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:50.754386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:50.755822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:50.755822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:50.773934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:50.776296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f6bb7-2d8e-43c5-925f-23c79732b3e9 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:50.797845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 839/1674] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:52.107954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:52.108853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:52.109284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:52.111317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 836/1675] 10.222.0.61 () {54 vars in 912 bytes} [Sat Aug 27 02:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:52.124985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:52.125519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:52.125774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:52.139531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:52.227653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:52.231753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:52.278756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:52.280935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:52.364255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 840/1676] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:52.399002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:52.400766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:52.420364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e5818-50b1-4576-ab84-cea9e79d8ac1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:52.432329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:52.435833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:52.437276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:52.439369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:52.440306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:52.467086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:52.471919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc61cc-3bd6-4570-9725-fd7abb694634 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:52.495905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 841/1677] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:52.503828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908cc41-6700-4f0d-92af-fd5b3da65836 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:52.531292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:52.535190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:52.535190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:52.535410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] PATH_INFO: `/v3/users/d08561462e074ac4af888fa855dd64ae` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:52.538327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08561462e074ac4af888fa855dd64ae)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:52.545871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:52.670451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08561462e074ac4af888fa855dd64ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:52.684465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08561462e074ac4af888fa855dd64ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:52.708485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08561462e074ac4af888fa855dd64ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:52.709960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08561462e074ac4af888fa855dd64ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:52.725018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08561462e074ac4af888fa855dd64ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:52.742102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 837/1678] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:20:52 2022] DELETE /identity/v3/users/d08561462e074ac4af888fa855dd64ae => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:52.744032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:52.744355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:52.744632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:52.796931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:52.798573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:52.997158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 842/1679] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:53.230950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:53.238559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:53.457098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d6ce5-8c41-4215-973b-b3b0774ae897 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:53.498085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:53.501571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:53.508453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:53.508821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:53.544216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:53.545912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e2d95-1aaf-4791-981b-8fa0b64c2a4b service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:53.585882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 838/1680] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:53.790591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:53.792827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:53.820608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba9f62-4c35-4a4f-a2b1-30c2c269e6d7 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:53.826421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:53.827403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:53.827849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:53.828256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] PATH_INFO: `/v3/users/c71dd94e52604191ba726a8b45b5f6b0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:53.842452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71dd94e52604191ba726a8b45b5f6b0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:53.844830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:53.935032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71dd94e52604191ba726a8b45b5f6b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:53.966919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71dd94e52604191ba726a8b45b5f6b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:53.967710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71dd94e52604191ba726a8b45b5f6b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:53.987227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71dd94e52604191ba726a8b45b5f6b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:53.987884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71dd94e52604191ba726a8b45b5f6b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:54.016132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:54.026816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 843/1681] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:20:53 2022] DELETE /identity/v3/users/c71dd94e52604191ba726a8b45b5f6b0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:54.233378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:54.234113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:54.234461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:54.315656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] MFA Rules not processed for user `4a6f819365574091ae344f14e47f487f`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:54.316945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:54.515399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:54.536477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 839/1682] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:54.556709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:54.559703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:54.751515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2450a0e-b8c3-4224-88a3-49f9b28adc9d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:54.766662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:54.767375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:54.768221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:54.768500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:54.782967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:54.784707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3629e80-c3f4-47cf-a89b-f0c0aa79f72e service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:54.797532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 844/1683] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:54.982501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:54.984470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:55.240382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:55.240845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:55.241236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:55.287633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] MFA Rules not processed for user `1eb664209056410d890d1b2b8bfa0155`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:55.295149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:55.297321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077ea9d-20f6-4905-bfca-c58d07a90c74 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:55.303690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:55.304618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:55.305069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:55.305350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:55.308962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:55.335881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:55.338073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:55.353541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 840/1684] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:55.391209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:55.393136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:55.511958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 845/1685] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:55.590321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13fa6f-c9fe-4cc4-bb64-9a9d71079a69 service placement] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:55.600781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:55.600781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:55.601307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:55.601920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] PATH_INFO: `/v3/projects/09b43d76207c40a8a5d7c6d1fb3564d1` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:55.603618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b43d76207c40a8a5d7c6d1fb3564d1)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:55.606491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:55.756296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b43d76207c40a8a5d7c6d1fb3564d1', 'request_id': 'req-821e452e-b58d-4c8d-b52f-c60050bcdb35'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:55.773360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b43d76207c40a8a5d7c6d1fb3564d1', 'request_id': 'req-821e452e-b58d-4c8d-b52f-c60050bcdb35'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:55.782049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b43d76207c40a8a5d7c6d1fb3564d1', 'request_id': 'req-821e452e-b58d-4c8d-b52f-c60050bcdb35'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:55.828245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] The token cache is being invalidate because project 09b43d76207c40a8a5d7c6d1fb3564d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:20:55.829047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:55.834224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-821e452e-b58d-4c8d-b52f-c60050bcdb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:55.839976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 841/1686] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:20:55 2022] DELETE /identity/v3/projects/09b43d76207c40a8a5d7c6d1fb3564d1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:55.844696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:55.868695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e11ee2-c87d-40b4-a4b4-369e7ada21ea None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:56.070123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:56.072687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:56.075704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:56.076074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] PATH_INFO: `/v3/users/de8949948bf44f5294bc74835993eeea` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:56.085153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8949948bf44f5294bc74835993eeea)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:56.087255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:56.197846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:56.234503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8949948bf44f5294bc74835993eeea'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:56.266134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8949948bf44f5294bc74835993eeea'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:56.267203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8949948bf44f5294bc74835993eeea'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:56.283936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8949948bf44f5294bc74835993eeea'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:56.284743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1d0d1b26-083e-4a58-a699-7a1ff761c69b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8949948bf44f5294bc74835993eeea'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:56.317264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 846/1687] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:20:55 2022] DELETE /identity/v3/users/de8949948bf44f5294bc74835993eeea => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:56.408379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:56.408859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:56.408987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:56.470965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:56.487059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] MFA Rules not processed for user `8fcf84d1b6d04255b62ab22d35e80280`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:56.491881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:56.807740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 842/1688] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:56.820611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:56.821264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:56.821730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:56.868577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] MFA Rules not processed for user `8fcf84d1b6d04255b62ab22d35e80280`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:56.870462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:56.893172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 847/1689] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:56.910710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:56.912510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:56.920768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:56.922791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:57.083965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb0b4b2-bc83-435c-a33b-e353d8d791d5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:57.089221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:57.090092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.090511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.090916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] PATH_INFO: `/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.092338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66abb0e122da49f1bdcb95ed5a830c7c)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:57.094983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:57.108525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499809eb-6d9b-4bef-ba1e-fcf7d0e7f2b7 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:57.123819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:57.124543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.124825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.125094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.152301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:57.157895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc24be-4d82-48c4-b7d8-e7be875b8896 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:57.167379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66abb0e122da49f1bdcb95ed5a830c7c', 'request_id': 'req-d9fb578f-0f03-454a-8059-2e232c06ab6e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.173746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66abb0e122da49f1bdcb95ed5a830c7c', 'request_id': 'req-d9fb578f-0f03-454a-8059-2e232c06ab6e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.180980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66abb0e122da49f1bdcb95ed5a830c7c', 'request_id': 'req-d9fb578f-0f03-454a-8059-2e232c06ab6e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.189653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 843/1690] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:57.200090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] The token cache is being invalidate because project 66abb0e122da49f1bdcb95ed5a830c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:20:57.200299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.201019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.203021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 848/1691] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:20:56 2022] DELETE /identity/v3/projects/66abb0e122da49f1bdcb95ed5a830c7c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:20:57.207886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fcec4-dae4-4bff-8a1a-f6562d8dbc14 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.208374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fcec4-dae4-4bff-8a1a-f6562d8dbc14 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.208935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fcec4-dae4-4bff-8a1a-f6562d8dbc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.240794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ce7fcec4-dae4-4bff-8a1a-f6562d8dbc14 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:57.242174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ce7fcec4-dae4-4bff-8a1a-f6562d8dbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:57.313628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:57.315454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:57.438764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:57.451038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 844/1692] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:57.460477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.461553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.479100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.540168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:57.547495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:57.555309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb578f-0f03-454a-8059-2e232c06ab6e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:57.575748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 845/1693] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:57.577899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:57.578708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.579138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.579538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] PATH_INFO: `/v3/projects/a8ea92846cdc41e88962eecb4337401d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.580586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:57.588101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ea92846cdc41e88962eecb4337401d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:57.590950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:57.611014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61522c4-8daf-4a1c-8af2-2a1036b16cae None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:57.626663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:57.628397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.629354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.629785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.631128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:57.631641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:57.638246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:57.678210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 846/1694] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:57.679501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:57.705263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f88e6-ba4e-4d65-afdf-81e304813e1a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:57.717181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:57.722004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ea92846cdc41e88962eecb4337401d', 'request_id': 'req-225134bf-6fa2-42b5-aec9-918923c0406b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.749103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ea92846cdc41e88962eecb4337401d', 'request_id': 'req-225134bf-6fa2-42b5-aec9-918923c0406b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.780881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ea92846cdc41e88962eecb4337401d', 'request_id': 'req-225134bf-6fa2-42b5-aec9-918923c0406b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.807267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] The token cache is being invalidate because project a8ea92846cdc41e88962eecb4337401d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:20:57.807566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.809421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-225134bf-6fa2-42b5-aec9-918923c0406b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:20:57.813717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 849/1695] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:20:57 2022] DELETE /identity/v3/projects/a8ea92846cdc41e88962eecb4337401d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:57.819904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c624c-64f9-4096-8675-f39031bf391b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.820198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c624c-64f9-4096-8675-f39031bf391b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.820478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c624c-64f9-4096-8675-f39031bf391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.906266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ca3c624c-64f9-4096-8675-f39031bf391b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:57.911461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ca3c624c-64f9-4096-8675-f39031bf391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:57.934863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:57.940203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:57.941993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:57.942358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:57.943128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:57.947621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.095128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 847/1696] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:57 2022] POST /identity/v3/projects => generated 363 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:58.096545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.103925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:58.191944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 850/1697] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:58.200986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.201584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.201881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.274316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:58.277142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:58.278444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f4bbc-541d-425a-821e-4b01aa576c9f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.294865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.295352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.295660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.296005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.296899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 851/1698] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:20:58.297011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.299272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17e4bd-c2b3-4a20-bbd4-7f5be7fbf009 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.301619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.329749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735ef46-e5e3-4fa2-8a0c-c4d0f4ac4e94 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.344405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.345232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.345587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.350416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.350416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:20:58.350416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.355867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e157ac-9aaf-4999-adf7-6b9acc0a1143 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.362550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 848/1699] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:58 2022] POST /identity/v3/users => generated 282 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:58.364168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc916-ed5e-445f-8c50-adab3ffcf164 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.370229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc916-ed5e-445f-8c50-adab3ffcf164 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.371688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc916-ed5e-445f-8c50-adab3ffcf164 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.374135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 849/1700] 10.222.0.61 () {54 vars in 912 bytes} [Sat Aug 27 02:20:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:20:58.381044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc916-ed5e-445f-8c50-adab3ffcf164 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.393833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 852/1701] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:20:58.395262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.395549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.395820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.423151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc916-ed5e-445f-8c50-adab3ffcf164 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.434055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.434948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.435437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.435901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.436799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.438704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.458589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:58.465663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 850/1702] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:58.466541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.469697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:58.477783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c39f0-f26c-447d-b180-4485e3c200f8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.492464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.493098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.493383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.493678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.494520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.498315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.539758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 851/1703] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:58 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:58.539758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.650819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:58.697867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:58.699433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 853/1704] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:20:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:58.714131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.724256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65141aa7-4d9a-4d22-a9bf-a9b6e5f6cca2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.739724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.741315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.742095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.742698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.743565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.745746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.755493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408258fb-facf-4456-9ba9-ac1c3374d742 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.767112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.767429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.768011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.768289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.768938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.773605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.783774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 852/1705] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:58.787100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.792548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:58.833303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 854/1706] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:58 2022] POST /identity/v3/users => generated 279 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:58.836143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:58.871101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f245-42b0-4647-82bf-be116b9acc73 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:58.886954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:58.888034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:58.888314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:58.888586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] PATH_INFO: `/v3/projects/70bffeccb24c4680a348254321f549f4/users/b6baf3df7c0d4e6b95a716651eb6f114/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:58.932854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70bffeccb24c4680a348254321f549f4, user_id=b6baf3df7c0d4e6b95a716651eb6f114, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:58.942142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:58.973966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 855/1707] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:58 2022] PUT /identity/v3/projects/70bffeccb24c4680a348254321f549f4/users/b6baf3df7c0d4e6b95a716651eb6f114/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:58.974861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.001523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6825c2-9a7b-41a5-8901-e1b7230f4dd8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.064005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa49c75-c88e-45ec-8227-29ff2d995358 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.071590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.072417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.073252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.073762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.074481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.076284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b904a0-dc51-4d22-97fd-aa90b53d07e9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.088298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 856/1708] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:59.093643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.093931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.094345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.131323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] MFA Rules not processed for user `b6baf3df7c0d4e6b95a716651eb6f114`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:59.133998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:59.148701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.149703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.157618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.158364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.175461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.177679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.210222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 853/1709] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:20:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:20:59.211157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.241655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75959e47-5c17-42d6-9954-1b19168c8dfb service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.251233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.251855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.252134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.252402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.253183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.255202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.274605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 854/1710] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:20:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:20:59.275627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.287527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc24dd-f909-46a3-bea7-70fc601e6b63 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.287641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 857/1711] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:59.293736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.294277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.295196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.296013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.296616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] PATH_INFO: `/v3/projects/c47a650b69ba4d05a0f6946642f80033/users/cdf8f2e684fd4935a44e1287013c057b/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.320155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c47a650b69ba4d05a0f6946642f80033, user_id=cdf8f2e684fd4935a44e1287013c057b, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.329983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d99e4-21cb-4f1a-acdb-bef0e4d84ff6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.347944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157fb9a3-e57c-4fe3-a347-537c505d53e0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.380760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 855/1712] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:20:59 2022] PUT /identity/v3/projects/c47a650b69ba4d05a0f6946642f80033/users/cdf8f2e684fd4935a44e1287013c057b/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:20:59.385650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.386092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.387531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.444399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:59.481445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] MFA Rules not processed for user `cdf8f2e684fd4935a44e1287013c057b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:20:59.483390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:20:59.571192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.571756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.572139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.572417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.573069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.575052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.664385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 858/1713] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/projects => generated 365 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:59.675633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.690959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:20:59.707956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 856/1714] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:20:59.708938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:20:59.742073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bdf7-86d5-44e5-a31b-1bda236a1ddb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.889077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fff1f-0ff0-45c5-814e-f627253e86f6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:20:59.909464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.910138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.910418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.910694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.911360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.913332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e299d1-4285-4d03-b7f9-ef0829a6de98 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.932578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:20:59.933471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.937312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.940187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:20:59.941052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:20:59.947010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:20:59.978183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 859/1715] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:20:59.979691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:20:59.979980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:20:59.980256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.060887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 857/1716] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/projects => generated 357 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:00.061297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.132535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:00.134073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:00.320966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3c5d1-dfe6-454c-b5f8-b0eaeaba38b7 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.349157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.350115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.350547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.351153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.351992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.354351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.380333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 860/1717] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:20:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:00.381125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.391858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 858/1718] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:00.397005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.420276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42dc91-bb4a-4f45-8949-96790abc5e60 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.425431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c3fd3-114b-40d3-8bd7-4a65b2d5f4cc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.426272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.426906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.427284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.427660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] PATH_INFO: `/v3/projects/dd5d161fb7714e55b5188450fbcf4215/users/1647e1b1e17f487189b77f1403140ea2/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.435532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.436168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.436445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.436778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.437456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.439440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.470434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5d161fb7714e55b5188450fbcf4215, user_id=1647e1b1e17f487189b77f1403140ea2, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.473095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.494710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 861/1719] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:00 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:00.496032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.539885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 859/1720] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:00 2022] PUT /identity/v3/projects/dd5d161fb7714e55b5188450fbcf4215/users/1647e1b1e17f487189b77f1403140ea2/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:00.550998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad71830-74c8-4159-a6b1-ef81218dbe80 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.554499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.564559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:00.691132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:00.699533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce35b-412b-481c-a1ad-eeefeb02cd82 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.714548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.715197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.715481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.715760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.716611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.718329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.752726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 860/1721] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:00.756504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.756759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.757242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.757624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.757898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.758638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.760365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.787492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e899b119-5a41-4ffd-bd37-cd6c15c2cfe4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:00.798159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:00.798539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:00.798755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:00.799042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] PATH_INFO: `/v3/projects/dd5d161fb7714e55b5188450fbcf4215/users/1647e1b1e17f487189b77f1403140ea2/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:00.814259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5d161fb7714e55b5188450fbcf4215, user_id=1647e1b1e17f487189b77f1403140ea2, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:00.816020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:00.816177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 862/1722] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:00.817129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:00.822979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:00.857616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 861/1723] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:00 2022] PUT /identity/v3/projects/dd5d161fb7714e55b5188450fbcf4215/users/1647e1b1e17f487189b77f1403140ea2/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:00.858408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:01.163064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f6d1a-a85b-4752-9c88-25bf27362cf8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:01.186125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:01.194275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:01.195904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:01.196192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] PATH_INFO: `/v3/projects/e3464878371040b0bad838574575dc93/users/fb736e23fa6949449a6e1f218ed42417/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:01.247773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6f169-353d-4f0a-97b7-2b088b281020 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:01.277900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3464878371040b0bad838574575dc93, user_id=fb736e23fa6949449a6e1f218ed42417, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:01.291527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c2210-809a-4dcb-b6ad-1cd85f2d98a0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:01.330641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 862/1724] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:00 2022] PUT /identity/v3/projects/e3464878371040b0bad838574575dc93/users/fb736e23fa6949449a6e1f218ed42417/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:01.332578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:01.332867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:01.333301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:01.382909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] MFA Rules not processed for user `1647e1b1e17f487189b77f1403140ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:01.385186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:01.440201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:01.443637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:01.443922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:01.444184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:01.510942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:01.621835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:01.627863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df953e22-6c3c-4a6f-a529-88950ae12d71 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:01.654771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 863/1725] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:21:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 838 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:21:01.655130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 863/1726] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:01.657826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:01.661672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:01.669513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:01.669941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:01.764073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] MFA Rules not processed for user `cd08f3b52004476b9eb532c7c68ab679`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:01.765725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:01.866879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:01.924909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148692f9-a3ac-4c9c-97fa-0c8f63344cd1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:01.939413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 864/1727] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:01.940993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:01.943164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:01.951584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:01.952305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:01.952594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:01.959181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:01.961325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:01.970825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:02.013479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 864/1728] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:02.015801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:02.024109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:02.162750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b56e6-3f4f-475a-bf46-35bd9e519655 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:02.180416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:02.183061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:02.183483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:02.183852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:02.220011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:02.224651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:02.283780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 865/1729] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:02.286989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:02.331720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a4898-e119-49b1-8235-8686bd14df40 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:02.349413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:02.355416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:02.357297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:02.357297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] PATH_INFO: `/v3/projects/e3464878371040b0bad838574575dc93/users/fb736e23fa6949449a6e1f218ed42417/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:02.376007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a302b-8ff4-4cc3-9e65-1707a0ca8520 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:02.387171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3464878371040b0bad838574575dc93, user_id=fb736e23fa6949449a6e1f218ed42417, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:02.395320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16dc82-246b-458d-b9cc-98bdd28a7733 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:02.421754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:02.422407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:02.422694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:02.427454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:02.473331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 866/1730] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:02 2022] PUT /identity/v3/projects/e3464878371040b0bad838574575dc93/users/fb736e23fa6949449a6e1f218ed42417/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:02.474952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:02.476759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:02.484340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:02.484784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:02.485216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:02.536370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 865/1731] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:02.784165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] MFA Rules not processed for user `fb736e23fa6949449a6e1f218ed42417`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:02.787441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:03.055868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:03.288851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 867/1732] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 806 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:03.353768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:03.366005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a701c4-c3cb-4992-999b-c008a231c979 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:03.548598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:03.549692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:03.550770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:03.552830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:03.576274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:03.581383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:03.610610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 866/1733] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:03.860890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:03.876485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a834-cd2b-40a3-84f7-349908db8126 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:03.890071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:03.891216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:03.891494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:03.892088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:04.132542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:04.134428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5442-ae4f-4087-9aad-7597402658b9 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:04.170891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 868/1734] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:04.681488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:04.852274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5881-b136-4704-917b-f4388e7e9c62 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:04.867636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:04.868516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:04.869060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:04.869600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] PATH_INFO: `/v3/users/b6baf3df7c0d4e6b95a716651eb6f114` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:04.872014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6baf3df7c0d4e6b95a716651eb6f114)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:04.878696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:04.919724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:05.022122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6baf3df7c0d4e6b95a716651eb6f114'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:05.037074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6baf3df7c0d4e6b95a716651eb6f114'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:05.074798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6baf3df7c0d4e6b95a716651eb6f114'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:05.077227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6baf3df7c0d4e6b95a716651eb6f114'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:05.093799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6baf3df7c0d4e6b95a716651eb6f114'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:05.138221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 867/1735] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:04 2022] DELETE /identity/v3/users/b6baf3df7c0d4e6b95a716651eb6f114 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:05.140231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43014-17dc-47e6-a030-f30dc75233e3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:05.141236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43014-17dc-47e6-a030-f30dc75233e3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:05.141714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb43014-17dc-47e6-a030-f30dc75233e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:05.177318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-aeb43014-17dc-47e6-a030-f30dc75233e3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:05.182012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-aeb43014-17dc-47e6-a030-f30dc75233e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:05.376918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 869/1736] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:05.423100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:05.425214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:05.635165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dad8a8-3859-4e31-b39e-c99acf19fef0 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:05.652596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfd5c-b7b7-41d8-a62f-f77ee28d172e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:05.652926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfd5c-b7b7-41d8-a62f-f77ee28d172e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:05.653224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3cfd5c-b7b7-41d8-a62f-f77ee28d172e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:05.670746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:05.673733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:05.676003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:05.678638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:05.694584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9e3cfd5c-b7b7-41d8-a62f-f77ee28d172e None None] MFA Rules not processed for user `4a6f819365574091ae344f14e47f487f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:05.695856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9e3cfd5c-b7b7-41d8-a62f-f77ee28d172e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:05.724379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:05.733987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acdf088-138c-483f-a587-a389591d79fd service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:05.843103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 868/1737] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:05.866455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 870/1738] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:06.038410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:06.038953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:06.039435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:06.127043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] MFA Rules not processed for user `22fbea2c71674b239e6d8fba6518e962`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:06.131477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:06.171120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:06.171719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:06.171812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:06.251220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:06.258297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:06.291332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 871/1739] 10.222.0.78 () {58 vars in 1015 bytes} [Sat Aug 27 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:06.407752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 869/1740] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:06.450705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:06.474516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66eb46-0b9f-4748-9a96-7954d0343c20 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:06.505423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:06.506631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:06.509685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:06.512078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:06.531541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:06.553972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:06.558743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a9265-f872-4e6d-8136-613c4d307d14 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:06.583963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 872/1741] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:07.355685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:07.358359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:07.437305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf0deb-b5ee-4928-9abc-b861d35ca053 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:07.463389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:07.464075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:07.464435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:07.464815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] PATH_INFO: `/v3/users/b12c29b8ad4547bba488a8d24335702c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:07.467659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12c29b8ad4547bba488a8d24335702c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:07.474763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:07.598025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:07.690715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12c29b8ad4547bba488a8d24335702c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:07.709876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12c29b8ad4547bba488a8d24335702c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:07.772465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12c29b8ad4547bba488a8d24335702c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:07.783161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12c29b8ad4547bba488a8d24335702c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:07.819037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12c29b8ad4547bba488a8d24335702c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:07.852559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 870/1742] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:07 2022] DELETE /identity/v3/users/b12c29b8ad4547bba488a8d24335702c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:07.858465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:07.858993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:07.859789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:07.926543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:07.926543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:08.030301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:08.032526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:08.196642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 873/1743] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:08.286492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89114b4-62a2-4bdf-85ad-548ec23a936c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:08.300037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:08.304032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:08.304464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:08.304741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:08.312540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:08.514946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:08.517559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:08.519744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:08.530254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:08.599528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 871/1744] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:08.854349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982311d-caf1-4c49-88fb-7ffaa8f5b27b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:08.868611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:08.870344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:08.870639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:08.870910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:08.905928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:08.907450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:08.910568 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:08.914324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:08.940183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 874/1745] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:08.955137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f5c26-a089-4c6e-ad13-7ea3cdd1dd29 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:08.983441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:08.984250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:08.984623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:08.984992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] PATH_INFO: `/v3/projects/70bffeccb24c4680a348254321f549f4` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:08.987108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70bffeccb24c4680a348254321f549f4)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:08.994288 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:09.113125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:09.146168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70bffeccb24c4680a348254321f549f4', 'request_id': 'req-07ee32e2-b176-469f-9e4a-11516970a6d0'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.158389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70bffeccb24c4680a348254321f549f4', 'request_id': 'req-07ee32e2-b176-469f-9e4a-11516970a6d0'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.184030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70bffeccb24c4680a348254321f549f4', 'request_id': 'req-07ee32e2-b176-469f-9e4a-11516970a6d0'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.199630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] The token cache is being invalidate because project 70bffeccb24c4680a348254321f549f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:09.200177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.201032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.203855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 872/1746] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:08 2022] DELETE /identity/v3/projects/70bffeccb24c4680a348254321f549f4 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:09.207759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:09.239509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbd311-a92d-4997-9aed-051adf09ddc3 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:09.358550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:09.359263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:09.359641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:09.360296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] PATH_INFO: `/v3/users/1647e1b1e17f487189b77f1403140ea2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:09.363309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1647e1b1e17f487189b77f1403140ea2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:09.367713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:09.508475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:09.532930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1647e1b1e17f487189b77f1403140ea2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.613497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1647e1b1e17f487189b77f1403140ea2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.621960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1647e1b1e17f487189b77f1403140ea2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.637667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1647e1b1e17f487189b77f1403140ea2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.640002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aecb7262-c52e-45b2-a10a-f00220bd06fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1647e1b1e17f487189b77f1403140ea2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:09.683140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 875/1747] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:09 2022] DELETE /identity/v3/users/1647e1b1e17f487189b77f1403140ea2 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:12.657883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:12.659323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:12.693055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ee32e2-b176-469f-9e4a-11516970a6d0 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:12.951426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:12.953523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:12.953980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:12.954377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] PATH_INFO: `/v3/projects/dd5d161fb7714e55b5188450fbcf4215` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:12.955761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5d161fb7714e55b5188450fbcf4215)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:12.958008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:13.087668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5d161fb7714e55b5188450fbcf4215', 'request_id': 'req-c81333e4-bbf9-480c-802a-edca541881ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:13.099424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5d161fb7714e55b5188450fbcf4215', 'request_id': 'req-c81333e4-bbf9-480c-802a-edca541881ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:13.108183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5d161fb7714e55b5188450fbcf4215', 'request_id': 'req-c81333e4-bbf9-480c-802a-edca541881ae'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:13.122873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] The token cache is being invalidate because project dd5d161fb7714e55b5188450fbcf4215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:13.123506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:13.124630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c81333e4-bbf9-480c-802a-edca541881ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:13.126821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 873/1748] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:12 2022] DELETE /identity/v3/projects/dd5d161fb7714e55b5188450fbcf4215 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:13.131363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.132013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.132013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.189815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:13.191239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:13.338582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 876/1749] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:13.344003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.344583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.344693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.384866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:13.387974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:13.418052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 874/1750] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:13.422259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:13.446959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c61655-54a3-4d30-9ae0-1d5f725dd54e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:13.461843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:13.462899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.463603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.463958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.464571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:13.465899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:13.472256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:13.503720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 877/1751] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:13.506660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:13.518529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa32b-cb90-4b43-8829-7885760d89b4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:13.534024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:13.534915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.535525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.535936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.537376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:13.539552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:13.625303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 875/1752] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:13 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:13.628556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:13.650989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a183e6-efa1-4bb6-be38-9102dc1cad9c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:13.760691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:13.763204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:13.804920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:13.839553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:13.843190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.845024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.847264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.849355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:13.857676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:13.932310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 878/1753] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:13 2022] POST /identity/v3/users => generated 283 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:13.936830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:13.964104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034ea0e-31a1-4be3-90eb-e9b5b3dafdcc admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:13.975344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bef1d2-8dcf-415a-b2ec-49d23610f93b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:13.987810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:13.989143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:13.989419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:13.989776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] PATH_INFO: `/v3/projects/5dd26cff8b984d66b04f58a2fe164a6e` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:13.994849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd26cff8b984d66b04f58a2fe164a6e)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:13.996823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:14.011515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:14.011515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.011515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.011515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.019869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:14.024931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:14.100161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 879/1754] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:14.101492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:14.136139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d4fd5-d525-429b-b90d-7492531b59fc admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:14.160952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:14.161712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.162056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.162600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.163333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:14.174252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:14.203279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 880/1755] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:14.206002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:14.220257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0df60f-acd1-4214-a102-78f5a9c701e2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:14.255561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:14.282994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd26cff8b984d66b04f58a2fe164a6e', 'request_id': 'req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.305792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd26cff8b984d66b04f58a2fe164a6e', 'request_id': 'req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.336835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd26cff8b984d66b04f58a2fe164a6e', 'request_id': 'req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.393101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] The token cache is being invalidate because project 5dd26cff8b984d66b04f58a2fe164a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:14.395588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.397965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff32b8b0-e4af-439e-8fde-f6c6d86f6661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.405794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 876/1756] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:13 2022] DELETE /identity/v3/projects/5dd26cff8b984d66b04f58a2fe164a6e => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:14.409296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.414706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.415228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.422524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 877/1757] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:21:14 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:21:14.426788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:14.431113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:14.440679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:14.441381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.441692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.445330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] PATH_INFO: `/v3/projects/645015fb513e4cda867b0a55500166e8/users/d6d6263c3ce0494c996dfa81d199f48b/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.487894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa11107-5d8c-4122-97bd-60d11ac904c1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:14.500151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=645015fb513e4cda867b0a55500166e8, user_id=d6d6263c3ce0494c996dfa81d199f48b, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:14.511696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0512e-4857-4a2c-9342-1bd025738fad admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:14.512203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:14.513319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.514157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.516371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] PATH_INFO: `/v3/users/f6f2607eef4a48058457a26ef72383df` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.518725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6f2607eef4a48058457a26ef72383df)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:14.523820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:14.564067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 881/1758] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:14 2022] PUT /identity/v3/projects/645015fb513e4cda867b0a55500166e8/users/d6d6263c3ce0494c996dfa81d199f48b/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:14.569249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.569589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.569913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.695694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:14.706814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:14.707190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6f2607eef4a48058457a26ef72383df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.727247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6f2607eef4a48058457a26ef72383df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.772923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6f2607eef4a48058457a26ef72383df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.776188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6f2607eef4a48058457a26ef72383df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.789801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-97e59bdf-8e14-4a97-bf9f-bdbccab50866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6f2607eef4a48058457a26ef72383df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:14.799522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 878/1759] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:14 2022] DELETE /identity/v3/users/f6f2607eef4a48058457a26ef72383df => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:14.801191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f660-997d-4ef9-a3af-8bcb3be45dd9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:14.801572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f660-997d-4ef9-a3af-8bcb3be45dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:14.801927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437f660-997d-4ef9-a3af-8bcb3be45dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:14.860728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6437f660-997d-4ef9-a3af-8bcb3be45dd9 None None] MFA Rules not processed for user `d6d6263c3ce0494c996dfa81d199f48b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:14.863279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6437f660-997d-4ef9-a3af-8bcb3be45dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:14.875010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:14.975610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 882/1760] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:14.992108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 879/1761] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:14.993686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:14.995355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:15.004073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135eb26-cd5f-4e0b-8996-864601d17fcb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.005416 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135eb26-cd5f-4e0b-8996-864601d17fcb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.005938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135eb26-cd5f-4e0b-8996-864601d17fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.051453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8135eb26-cd5f-4e0b-8996-864601d17fcb None None] MFA Rules not processed for user `cd08f3b52004476b9eb532c7c68ab679`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:15.054477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8135eb26-cd5f-4e0b-8996-864601d17fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:15.160449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1899110-d907-4716-9f8d-4569c4b1e5f0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:15.209991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 880/1762] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:15.246592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:15.265294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098f60-5fd1-4b47-a9c9-7db97599fdea None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.266497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098f60-5fd1-4b47-a9c9-7db97599fdea None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.266497 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30098f60-5fd1-4b47-a9c9-7db97599fdea None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.269660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 881/1763] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:21:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:21:15.292729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:15.294608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.296586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.296867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.297587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:15.300397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab8d6b-f47a-4442-9ffd-2cd98e10950f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:15.364974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 883/1764] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:14 2022] POST /identity/v3/projects => generated 365 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:15.365925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098f60-5fd1-4b47-a9c9-7db97599fdea None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:15.480121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.480679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.481850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.598362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:15.610593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:15.624821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30098f60-5fd1-4b47-a9c9-7db97599fdea None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:15.673854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:15.675923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.679050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.680496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.687717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:15.690492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:15.771483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 882/1765] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:15 2022] POST /identity/v3/users => generated 289 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:15.773704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:15.779129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:15.853507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 884/1766] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:21:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:15.854393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:15.876191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e4c11-61e5-49ce-89db-78fe3b8401f1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:15.876905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:15.889207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:15.889936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.890221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.890505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.891137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:15.893094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:15.908735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac10b6-932d-4fd9-8194-a03c5fd398aa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:15.917328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 885/1767] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:15.918494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:15.928247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:15.928823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.928927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.929180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.943181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae157d6-1cee-4498-902c-2eb19891e086 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:15.949731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:15.952100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:15.956557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:15.957230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:15.957538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:15.957814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] PATH_INFO: `/v3/projects/3c4bef608c1644638643a02681d91ef4/users/8e559e0237c846efb9c3c68c1f9a1c3a/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:15.979304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 883/1768] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:15.985355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4bef608c1644638643a02681d91ef4, user_id=8e559e0237c846efb9c3c68c1f9a1c3a, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:15.988513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.007176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 886/1769] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:15 2022] PUT /identity/v3/projects/3c4bef608c1644638643a02681d91ef4/users/8e559e0237c846efb9c3c68c1f9a1c3a/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:16.011432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:16.024153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bfb92-0861-44b3-ab0b-84f3846927ef service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:16.091390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:16.092420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.092809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.093172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.094133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:16.096140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6da7c-9ec7-4502-aff5-098cdd036a2b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.112708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:16.120548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 884/1770] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:16.125351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35853aa5-4d60-4a61-a754-25a8f0331d87 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:16.132717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:16.133917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.134430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.134908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] PATH_INFO: `/v3/projects/3c4bef608c1644638643a02681d91ef4/users/8e559e0237c846efb9c3c68c1f9a1c3a/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.137705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c4bef608c1644638643a02681d91ef4, user_id=8e559e0237c846efb9c3c68c1f9a1c3a, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:16.143479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.173605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.174055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.174425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.177242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 887/1771] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:16 2022] PUT /identity/v3/projects/3c4bef608c1644638643a02681d91ef4/users/8e559e0237c846efb9c3c68c1f9a1c3a/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:16.207360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] MFA Rules not processed for user `8e559e0237c846efb9c3c68c1f9a1c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:16.208955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:16.331224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 885/1772] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:16.341026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:16.343153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:16.464023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:16.479264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c12f78-91f6-4f1e-970b-3ecca0241bb3 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:16.494861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:16.495833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.496258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.496887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.536079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:16.539809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.573610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 888/1773] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:16.607182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:16.647569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159d4f9-5ead-4e17-97ac-4999dfcd0045 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:16.668645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:16.669360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.669792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.670145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.680970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:16.682734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.703335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 886/1774] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:16.774371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:16.797515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27361c-fbcc-40fc-8a0c-4e55ec688d2a service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:16.805792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:16.806546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:16.807493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:16.808026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:16.824145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:16.927800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:16.932466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af9c6-3793-4c9e-b249-136e2e51af15 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:16.949919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 889/1775] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:18.061448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.063121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:18.147217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bff8e1-ee76-4428-88c0-eaf564fe09fe service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.152218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.152856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.153167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.153428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] PATH_INFO: `/v3/projects/03a2849003724c5f9767aba8b009f988` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.154557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a2849003724c5f9767aba8b009f988)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:18.156471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:18.215479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a2849003724c5f9767aba8b009f988', 'request_id': 'req-f9da6134-4f2d-422b-90c7-4097d3cb1a06'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:18.225637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a2849003724c5f9767aba8b009f988', 'request_id': 'req-f9da6134-4f2d-422b-90c7-4097d3cb1a06'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:18.238148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a2849003724c5f9767aba8b009f988', 'request_id': 'req-f9da6134-4f2d-422b-90c7-4097d3cb1a06'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:18.255328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] The token cache is being invalidate because project 03a2849003724c5f9767aba8b009f988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:18.255699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:18.256632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f9da6134-4f2d-422b-90c7-4097d3cb1a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:18.261446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 887/1776] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:18 2022] DELETE /identity/v3/projects/03a2849003724c5f9767aba8b009f988 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:18.263474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.264651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.265115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.287108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:18.288349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:18.364989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 890/1777] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:18.374320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.374676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.375045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.422882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:18.433583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:18.455099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 888/1778] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:18.459362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.470624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5d137-405e-46b5-bca3-1b12fbdb24e4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.484882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.486405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.486689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.488042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.488722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:18.490103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:18.492925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:18.524074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 891/1779] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:18.526986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.540346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25ec78-7cff-452e-b038-cdc7c15583f7 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.573595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.574227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.574806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.574806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.582085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:18.590203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:18.680712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 889/1780] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:18 2022] POST /identity/v3/projects => generated 387 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:18.684528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.705034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2d8ff-024c-4b37-a713-6ea3835a7f70 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.844069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.844794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.845073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.845345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.846516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:18.851032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:18.893754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 892/1781] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:18 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:18.897780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.914896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b838-50d3-44dc-ad52-330de08bfbaa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.925723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.926987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:18.927541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:18.928095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:18.930673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:18.933311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:18.961163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 890/1782] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:18.975957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:18.991983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38a77f-bd72-429b-8388-3ff266b5a605 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:18.998666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:18.999711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.000090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.000362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.001071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.003717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96362760-f447-45e8-84db-88d0d100f53f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:19.020098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 893/1783] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:19.027759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:19.072214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cd95a-c351-4170-b415-d33e98e3ba10 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:19.088675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:19.089602 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.089935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.090218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] PATH_INFO: `/v3/projects/26f4009286434d27baf19f8cec664dde/users/1c4a9d2c13ac456c8cc9b237102bda2b/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.137663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f4009286434d27baf19f8cec664dde, user_id=1c4a9d2c13ac456c8cc9b237102bda2b, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.164038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:19.197876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 891/1784] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:19 2022] PUT /identity/v3/projects/26f4009286434d27baf19f8cec664dde/users/1c4a9d2c13ac456c8cc9b237102bda2b/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:19.209232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.209960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.210621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.237538 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:19.250464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] MFA Rules not processed for user `1c4a9d2c13ac456c8cc9b237102bda2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:19.253843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:19.401483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 894/1785] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:19.404907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:19.410137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:19.569592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5188d-2bf4-43b7-98a6-faba75b7c7ee admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:19.584317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:19.584974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.585258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.585563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.586215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.588134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:19.662925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 892/1786] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:19.664418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:19.686367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a3d7-aa18-491f-9017-58ce4f1a5192 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:19.828414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:19.829934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.830269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.830787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.831535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.835216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:19.883956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 895/1787] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:19 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:19.887996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:19.903706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7d0ce-f8a7-4713-966f-d7a8cee67c7c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:19.910284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:19.911280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.911718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.912219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.913090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.915009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:19.945314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 893/1788] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:19.947492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:19.959022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1a366-0cd6-4910-a64d-d758e9473a1c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:19.964709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:19.965659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:19.966003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:19.966339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] PATH_INFO: `/v3/projects/0343e708b06847faa2dca4b4382f965c/users/54afaaac222b4fa686cb3040ffced34d/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:19.985637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0343e708b06847faa2dca4b4382f965c, user_id=54afaaac222b4fa686cb3040ffced34d, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:19.989002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5478918-b636-4b2f-804e-1eb9e1553149 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:20.007593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 896/1789] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:19 2022] PUT /identity/v3/projects/0343e708b06847faa2dca4b4382f965c/users/54afaaac222b4fa686cb3040ffced34d/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:20.011255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:20.023067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631631e-91e4-4944-92cb-bc9506ed6a15 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:20.088198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:20.088824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.089290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.089721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.090505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:20.092667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:20.094324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.094616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.094888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.103810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 894/1790] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:20.108325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:20.118323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] MFA Rules not processed for user `22fbea2c71674b239e6d8fba6518e962`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:20.119853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:20.120879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f634b4-203e-4ccb-82e0-41a3f1683eaf admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:20.133058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:20.138244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.138536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.138815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] PATH_INFO: `/v3/projects/0343e708b06847faa2dca4b4382f965c/users/54afaaac222b4fa686cb3040ffced34d/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.144216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0343e708b06847faa2dca4b4382f965c, user_id=54afaaac222b4fa686cb3040ffced34d, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:20.147150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa306cf-b41a-4a35-b6ec-dda9d1d262e3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:20.162877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 895/1791] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:20 2022] PUT /identity/v3/projects/0343e708b06847faa2dca4b4382f965c/users/54afaaac222b4fa686cb3040ffced34d/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:20.176242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.176543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.176822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.216391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 897/1792] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:20.218324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] MFA Rules not processed for user `54afaaac222b4fa686cb3040ffced34d`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:20.219606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:20.282517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:20.324320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 896/1793] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:20.336387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:20.338565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:20.360098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:20.408560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc715012-1728-46b3-9036-e8d57bef0ca1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:20.462400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:20.463268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.463546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.463828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.474654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:20.483982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8c6e7-264d-4015-9488-b17aa70c7e78 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:20.498322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 898/1794] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:20.602737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:20.718985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380025a-0a9b-4493-8e52-94a4becb66c4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:20.727589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:20.729323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.729323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.729323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] PATH_INFO: `/v3/users/1c4a9d2c13ac456c8cc9b237102bda2b` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.730729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4a9d2c13ac456c8cc9b237102bda2b)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:20.733236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:20.805721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4a9d2c13ac456c8cc9b237102bda2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:20.815009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4a9d2c13ac456c8cc9b237102bda2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:20.858722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4a9d2c13ac456c8cc9b237102bda2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:20.861191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4a9d2c13ac456c8cc9b237102bda2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:20.890148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4a9d2c13ac456c8cc9b237102bda2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:20.907308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 897/1795] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:20 2022] DELETE /identity/v3/users/1c4a9d2c13ac456c8cc9b237102bda2b => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:20.910530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:20.911559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:20.912506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:20.963014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:20.964271 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:21.047170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 899/1796] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:21.076761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:21.078867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:21.170457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c49b-9892-4d67-a83c-635fc9376d18 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:21.174675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:21.175614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:21.175897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:21.176181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:21.201199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:21.203311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:21.215329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 898/1797] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:23.036351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:23.038363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:23.065598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edaa15-964b-401f-a2b8-57fc3ffda365 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:23.093966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:23.099400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:23.099754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:23.100329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] PATH_INFO: `/v3/projects/26f4009286434d27baf19f8cec664dde` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:23.102957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f4009286434d27baf19f8cec664dde)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:23.107044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:23.251530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f4009286434d27baf19f8cec664dde', 'request_id': 'req-af6adfd7-d71e-4958-9068-09a5d37a740d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.261643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f4009286434d27baf19f8cec664dde', 'request_id': 'req-af6adfd7-d71e-4958-9068-09a5d37a740d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.272171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f4009286434d27baf19f8cec664dde', 'request_id': 'req-af6adfd7-d71e-4958-9068-09a5d37a740d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.276297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:23.325465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] The token cache is being invalidate because project 26f4009286434d27baf19f8cec664dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:23.326010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.326912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-af6adfd7-d71e-4958-9068-09a5d37a740d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.328659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 900/1798] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:23 2022] DELETE /identity/v3/projects/26f4009286434d27baf19f8cec664dde => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:23.332825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:23.345585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34d57b-2cd5-4676-b70f-68dd51a82567 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:23.349731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:23.424801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:23.425768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:23.426189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:23.426598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] PATH_INFO: `/v3/users/54afaaac222b4fa686cb3040ffced34d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:23.428568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54afaaac222b4fa686cb3040ffced34d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:23.432102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:23.522600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54afaaac222b4fa686cb3040ffced34d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.549833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54afaaac222b4fa686cb3040ffced34d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.601774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54afaaac222b4fa686cb3040ffced34d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.604644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54afaaac222b4fa686cb3040ffced34d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.624684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a868db0-051c-4f7e-9e76-39544016109e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54afaaac222b4fa686cb3040ffced34d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:23.637700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 899/1799] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:23 2022] DELETE /identity/v3/users/54afaaac222b4fa686cb3040ffced34d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:24.393491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:24.394369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:24.394838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:24.399236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 901/1800] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:21:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:21:24.432277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:24.432874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:24.432874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:24.480844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:24.486711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:24.649898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 900/1801] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:21:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:25.060993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.064591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.095013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.096886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.120854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18083d4-4309-4fba-897a-7d4e5239bb9e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.135658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.136594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.136898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.137224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.147327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac5e0-cc71-48fa-8648-6bfdfe1f572e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.154889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.156492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ce198-e8f5-4647-b40e-ebdd1a78a5fe service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.160029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.160675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.161201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.161646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] PATH_INFO: `/v3/projects/0343e708b06847faa2dca4b4382f965c` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.166290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0343e708b06847faa2dca4b4382f965c)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.168386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.185637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 901/1802] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:25.251174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0343e708b06847faa2dca4b4382f965c', 'request_id': 'req-40749e62-6ff3-4187-a6ce-426cb069de8d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.258835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0343e708b06847faa2dca4b4382f965c', 'request_id': 'req-40749e62-6ff3-4187-a6ce-426cb069de8d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.267963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0343e708b06847faa2dca4b4382f965c', 'request_id': 'req-40749e62-6ff3-4187-a6ce-426cb069de8d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.308957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] The token cache is being invalidate because project 0343e708b06847faa2dca4b4382f965c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:25.314065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.318490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40749e62-6ff3-4187-a6ce-426cb069de8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.323027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 902/1803] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:25 2022] DELETE /identity/v3/projects/0343e708b06847faa2dca4b4382f965c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:25.327502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.327943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.328513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.342158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:25.394151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:25.399581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.551009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 902/1804] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:25.560335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.561251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.561715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.611956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:25.614034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.628588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 903/1805] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:25.629406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.645165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d505-e049-4b15-b2d2-3a1de3ca6b5e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.650480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.651190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.651535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.651905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.652773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:25.654251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.657796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.687536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 903/1806] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:21:25.689666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.702990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0a07-6fd8-4fa5-8ee2-283f8cf19562 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.720881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.722805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.727732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.733656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.735015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.736512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.737013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.741929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.751515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926497-d502-4b86-a4d9-ebbb5e655053 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.770548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.771456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.771963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.772549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] PATH_INFO: `/v3/users/cdf8f2e684fd4935a44e1287013c057b` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.775381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf8f2e684fd4935a44e1287013c057b)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.780561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.800931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 904/1807] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:25 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:25.800931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.800931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:25.896043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf8f2e684fd4935a44e1287013c057b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.903688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:25.910073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf8f2e684fd4935a44e1287013c057b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.912163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c51d7-250e-47f0-be4c-59301334fc40 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:25.922500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:25.923585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:25.923931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:25.924457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] PATH_INFO: `/v3/users/d6d6263c3ce0494c996dfa81d199f48b` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:25.926654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6d6263c3ce0494c996dfa81d199f48b)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:25.929771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:25.929981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf8f2e684fd4935a44e1287013c057b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.930808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf8f2e684fd4935a44e1287013c057b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.947306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf8f2e684fd4935a44e1287013c057b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:25.959013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 904/1808] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:25 2022] DELETE /identity/v3/users/cdf8f2e684fd4935a44e1287013c057b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:25.960286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:25.962049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.033298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6d6263c3ce0494c996dfa81d199f48b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:26.059959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6d6263c3ce0494c996dfa81d199f48b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:26.059959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6d6263c3ce0494c996dfa81d199f48b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:26.067566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6d6263c3ce0494c996dfa81d199f48b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:26.070517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-194a3190-a816-4673-bdc4-5a02ac13fb07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6d6263c3ce0494c996dfa81d199f48b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:26.089357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77cf11-f09f-499e-bdc1-d227e79b439b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.102571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.103181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.103464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.103725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.105030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.107038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db099c61-1579-4351-8e8d-2147dc615230 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.109994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 905/1809] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:25 2022] DELETE /identity/v3/users/d6d6263c3ce0494c996dfa81d199f48b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:26.111653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.112133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.112637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.119490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:26.151193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:26.154156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.169213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 905/1810] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:25 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:26.175640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.177013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.177723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.221566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:26.224017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.264931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 906/1811] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:26.270942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.273822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.293701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bcb83-4801-4c67-97bb-5553786b225b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.316662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.317843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.317843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.318180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.318987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.321522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.336891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 907/1812] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:26.340272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 906/1813] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:26.343084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.355540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.357189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.357969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a4cd9-b08b-4e75-97a9-6197fa9ea168 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.365726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.366624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.367141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.367586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.368334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.370283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.394889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 908/1814] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:26.394889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.397152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.491272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3fac7-8605-4c01-8b3e-fcca0ebcbd8f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.495916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.496567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.497616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.497858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.510974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.513024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.526338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 907/1815] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:26.527388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.537731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca09057-f038-4d3f-b856-cd4e94adea49 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.537970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6da8c-6a38-45f0-8324-ae6018fec534 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.543845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.544461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.544758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.545006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.548818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.549719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.550143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.550644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] PATH_INFO: `/v3/projects/6bd9a1bc030a4740a2830512e789c697/users/76558358e2734245b8eae4918299177e/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.554137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:26.558913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.562562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb958e-6825-4240-967a-e404242b74cf service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.594645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 909/1816] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:26.598007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd9a1bc030a4740a2830512e789c697, user_id=76558358e2734245b8eae4918299177e, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.601051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.617538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 908/1817] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:26 2022] PUT /identity/v3/projects/6bd9a1bc030a4740a2830512e789c697/users/76558358e2734245b8eae4918299177e/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:26.628307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.628617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.628893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.664600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] MFA Rules not processed for user `76558358e2734245b8eae4918299177e`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:26.666165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:26.750198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 910/1818] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:26.756032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.869727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e670-815d-4b11-97b9-1de21f74542f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:26.875996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:26.876737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:26.877117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:26.877537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:26.878604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:26.880755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:26.910063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:26.925963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 909/1819] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:26 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:26.930593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:26.943448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834d2d-ef2d-43cf-97d9-0a739a29fdd0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.016723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.017363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.018205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.018360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.019019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.021129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.051136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 911/1820] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:26 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:27.055373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.088762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab6f8a-52b3-4ea8-b13b-93a685767ad5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.096595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.097237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.097915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.097915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.098477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.100106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.128803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 910/1821] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:27.129546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.139976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc9a72-017e-45c9-9eba-2e2e4c3c3817 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.146800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.147750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.147750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.147940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] PATH_INFO: `/v3/projects/dd0188f35c58495495b93261c3e0ab51/users/5142d472c3134ca194ab702734889e42/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.172022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0188f35c58495495b93261c3e0ab51, user_id=5142d472c3134ca194ab702734889e42, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.174800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.190382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 912/1822] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:27 2022] PUT /identity/v3/projects/dd0188f35c58495495b93261c3e0ab51/users/5142d472c3134ca194ab702734889e42/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:27.194995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.206913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da3240-0097-4938-97c9-a7206b9bd970 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.288697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.289736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.290014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.290286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.290942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.292612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671e5b2-3fe0-4fbe-be73-0c56b80600ba admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.303813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 911/1823] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:27.309461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.320414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecdcde-2182-41d7-b429-4e5cedacf575 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.326264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.327305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.327305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.327559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] PATH_INFO: `/v3/projects/dd0188f35c58495495b93261c3e0ab51/users/5142d472c3134ca194ab702734889e42/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.329773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd0188f35c58495495b93261c3e0ab51, user_id=5142d472c3134ca194ab702734889e42, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.332531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.345330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 913/1824] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:27 2022] PUT /identity/v3/projects/dd0188f35c58495495b93261c3e0ab51/users/5142d472c3134ca194ab702734889e42/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:27.356971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.357575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.358074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.410259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] MFA Rules not processed for user `5142d472c3134ca194ab702734889e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:27.411498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:27.418840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.421132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:27.549463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:27.574069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 912/1825] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:27.588763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.590327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:27.644831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39185345-4fee-4905-a65c-0c8122967ee7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.654756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.655330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.655609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.655881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] PATH_INFO: `/v3/projects/c47a650b69ba4d05a0f6946642f80033` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.658312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c47a650b69ba4d05a0f6946642f80033)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.661191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.720005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f80ec-b0ce-45b9-a1f7-374a836b9f76 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.727332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:27.729747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:27.730032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:27.730309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:27.756195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:27.758130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:27.768102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c47a650b69ba4d05a0f6946642f80033', 'request_id': 'req-b8cf5750-89fc-4662-a07e-73e43436bc98'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:27.779766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c47a650b69ba4d05a0f6946642f80033', 'request_id': 'req-b8cf5750-89fc-4662-a07e-73e43436bc98'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:27.782349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 913/1826] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:27.783774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.787784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:27.793221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c47a650b69ba4d05a0f6946642f80033', 'request_id': 'req-b8cf5750-89fc-4662-a07e-73e43436bc98'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:27.818666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] The token cache is being invalidate because project c47a650b69ba4d05a0f6946642f80033 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:27.819127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:27.820594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234fe63-4fc7-4152-bbae-0955e0f0440f service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:27.821854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:27.830101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 914/1827] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:27 2022] DELETE /identity/v3/projects/c47a650b69ba4d05a0f6946642f80033 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:27.830996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:27.835604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:27.843929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:28.003828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.004158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf5750-89fc-4662-a07e-73e43436bc98 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.004561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.004849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.005127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] PATH_INFO: `/v3/projects/645015fb513e4cda867b0a55500166e8` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.007422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] RBAC: Authorizing `identity:delete_project(project_id=645015fb513e4cda867b0a55500166e8)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.009887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.010651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.011020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.011391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] PATH_INFO: `/v3/users/fb736e23fa6949449a6e1f218ed42417` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.012504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.012915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb736e23fa6949449a6e1f218ed42417)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.015671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.110405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645015fb513e4cda867b0a55500166e8', 'request_id': 'req-45837c5b-d514-4603-9972-619dbbffe45c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.125185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645015fb513e4cda867b0a55500166e8', 'request_id': 'req-45837c5b-d514-4603-9972-619dbbffe45c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.125509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb736e23fa6949449a6e1f218ed42417'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.142121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645015fb513e4cda867b0a55500166e8', 'request_id': 'req-45837c5b-d514-4603-9972-619dbbffe45c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.147174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb736e23fa6949449a6e1f218ed42417'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.148896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb736e23fa6949449a6e1f218ed42417'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.156267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:28.160091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] The token cache is being invalidate because project 645015fb513e4cda867b0a55500166e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:28.160258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.164630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb736e23fa6949449a6e1f218ed42417'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.165276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.167022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 914/1828] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:27 2022] DELETE /identity/v3/projects/645015fb513e4cda867b0a55500166e8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:28.168442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb736e23fa6949449a6e1f218ed42417'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.171404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:28.173209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:28.200057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 915/1829] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:27 2022] DELETE /identity/v3/users/fb736e23fa6949449a6e1f218ed42417 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:28.272167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45837c5b-d514-4603-9972-619dbbffe45c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.329274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:28.360655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.361238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.361571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.361850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] PATH_INFO: `/v3/users/8e559e0237c846efb9c3c68c1f9a1c3a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.363028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e559e0237c846efb9c3c68c1f9a1c3a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.370646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.423009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:28.424462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:28.455807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e559e0237c846efb9c3c68c1f9a1c3a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.470090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e559e0237c846efb9c3c68c1f9a1c3a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.492194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e559e0237c846efb9c3c68c1f9a1c3a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.493555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e559e0237c846efb9c3c68c1f9a1c3a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.502977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e559e0237c846efb9c3c68c1f9a1c3a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:28.514746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 915/1830] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:28 2022] DELETE /identity/v3/users/8e559e0237c846efb9c3c68c1f9a1c3a => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:28.550906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6309fa-fe3e-48cd-9457-45285d517341 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.660933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142d472c3134ca194ab702734889e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd0188f35c58495495b93261c3e0ab51', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.661659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.662141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.662257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.663384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:28.663634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.665945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.682686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 916/1831] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:28.687183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:28.688942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:28.720756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6daef-6557-4edf-99f0-3a4053ac2bd5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.726995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142d472c3134ca194ab702734889e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd0188f35c58495495b93261c3e0ab51', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.727363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.727818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.729884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.730567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.732898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.775289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 916/1832] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:28 2022] POST /identity/v3/projects => generated 355 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:28.776593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:28.788729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5cbac-884d-4449-b1d6-43e74ef0a138 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.790306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:28.792257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:28.916556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142d472c3134ca194ab702734889e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd0188f35c58495495b93261c3e0ab51', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.917384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.917792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.918184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.918968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:28.919503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.921438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:28.939390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ecf0-a09f-46a5-a405-341d5bd95362 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:28.941090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 917/1833] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:28.951899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:28.952660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:28.953024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:28.953365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] PATH_INFO: `/v3/projects/e3464878371040b0bad838574575dc93` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:28.954605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3464878371040b0bad838574575dc93)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:28.956969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.035032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:29.035442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.039045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3464878371040b0bad838574575dc93', 'request_id': 'req-10fccba7-a072-4ee1-a589-8a6da685762f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.053331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3464878371040b0bad838574575dc93', 'request_id': 'req-10fccba7-a072-4ee1-a589-8a6da685762f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.056905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cdb8e-bdb7-4190-9c5a-a351847450f8 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.062995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3464878371040b0bad838574575dc93', 'request_id': 'req-10fccba7-a072-4ee1-a589-8a6da685762f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.075876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] The token cache is being invalidate because project e3464878371040b0bad838574575dc93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:29.076256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.077022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10fccba7-a072-4ee1-a589-8a6da685762f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.082663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 917/1834] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:28 2022] DELETE /identity/v3/projects/e3464878371040b0bad838574575dc93 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:29.084441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bc5a-5959-434d-8b99-793002470bc2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.084740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bc5a-5959-434d-8b99-793002470bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.085079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20bc5a-5959-434d-8b99-793002470bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.099822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:29.113064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8d20bc5a-5959-434d-8b99-793002470bc2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:29.114608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8d20bc5a-5959-434d-8b99-793002470bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.151177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5142d472c3134ca194ab702734889e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd0188f35c58495495b93261c3e0ab51', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.151835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.152121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.152400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] PATH_INFO: `/v3/projects/c82f61183d2740448d2153f447cc876e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.153930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c82f61183d2740448d2153f447cc876e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.156101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.201555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 918/1835] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:29.207355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.207719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.208093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.221436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82f61183d2740448d2153f447cc876e', 'request_id': 'req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.234781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:29.237453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.246957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82f61183d2740448d2153f447cc876e', 'request_id': 'req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.256917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82f61183d2740448d2153f447cc876e', 'request_id': 'req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.274082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] The token cache is being invalidate because project c82f61183d2740448d2153f447cc876e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:29.274571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.275602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.281735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 918/1836] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:29 2022] DELETE /identity/v3/projects/c82f61183d2740448d2153f447cc876e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:29.282697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.284611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.405467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 919/1837] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:29.406801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.430720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df71681-9e58-4e9d-904b-72858f142bbb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.441383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafe09f-cd0b-40aa-8b1f-7ee1be02f694 tempest-VolumeQuotaClassesTest-933488231 tempest-VolumeQuotaClassesTest-933488231-project-admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.442625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.443336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.443680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.444025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.444775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:29.445231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.447376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.460905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.461869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.462148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.462423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] PATH_INFO: `/v3/projects/3c4bef608c1644638643a02681d91ef4` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.465007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c4bef608c1644638643a02681d91ef4)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.465730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 920/1838] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:29.471119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.471532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.488954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c95fe3-9d4c-4827-91e5-aab4d5a4b41f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.494620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.495661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.496023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.496495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.497880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.499828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.545764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 921/1839] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:29.555292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.580679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c4bef608c1644638643a02681d91ef4', 'request_id': 'req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.586769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:29.589975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c4bef608c1644638643a02681d91ef4', 'request_id': 'req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.600777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c4bef608c1644638643a02681d91ef4', 'request_id': 'req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.625959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] The token cache is being invalidate because project 3c4bef608c1644638643a02681d91ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:29.626536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.628686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-74bc1c9d-2019-4a87-b98f-cca6b66b73b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.632104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 919/1840] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:29 2022] DELETE /identity/v3/projects/3c4bef608c1644638643a02681d91ef4 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:29.638592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.638906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.639236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.645271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:29.674963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:29.676247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.678207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a633500-4e25-4f9c-aeec-1faca2095834 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.764325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950834-7863-4615-980e-9853758627fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.765010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950834-7863-4615-980e-9853758627fb admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.765207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950834-7863-4615-980e-9853758627fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.765515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7950834-7863-4615-980e-9853758627fb admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.766165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950834-7863-4615-980e-9853758627fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.770817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7950834-7863-4615-980e-9853758627fb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.797229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 920/1841] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:29.798616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.803047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.803196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 922/1842] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:29.805428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950834-7863-4615-980e-9853758627fb admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.809558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a7950834-7863-4615-980e-9853758627fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.814692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64f975-60cd-49e2-8b57-bb0f8cf731bc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.822033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.823038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.823397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.823740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] PATH_INFO: `/v3/users/76558358e2734245b8eae4918299177e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.826106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76558358e2734245b8eae4918299177e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.828616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.841289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7950834-7863-4615-980e-9853758627fb admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.846741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.847466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.848083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.848363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.849095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.851474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6c0d8-6b74-4192-872f-5907e8cf3a0a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.867535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 923/1843] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:29.867535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.867535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.867535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.892301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:29.894733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.908724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76558358e2734245b8eae4918299177e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.913387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 924/1844] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:29.914419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.931760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e28b0-fc5e-4b45-87ed-ed0348291aac None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:29.938846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:29.940585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:29.941092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:29.941592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:29.943199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:29.945214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76558358e2734245b8eae4918299177e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.946005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76558358e2734245b8eae4918299177e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.946340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:29.965315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 925/1845] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:29.966621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:29.969314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:29.970261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76558358e2734245b8eae4918299177e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.975662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76558358e2734245b8eae4918299177e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:29.993041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d074e2-acfb-4fb2-9c1f-1d0729ddb78d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.000352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.000982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.001265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.001621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.002276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 921/1846] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:29 2022] DELETE /identity/v3/users/76558358e2734245b8eae4918299177e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:30.002888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.005636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:30.006221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.008118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63915ca-1737-4403-ad93-cec0f0a44d1f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.008575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:30.027742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 926/1847] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:30.030011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.030402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.030844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.057590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:30.059024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:30.090274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:30.099166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b598a-e08d-4154-9cae-438df5ef7a6c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.105802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.106404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.106679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.106949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] PATH_INFO: `/v3/projects/8ea2b44585df476e85ec358922eb642e/users/8fd8f7ed0c644dd49207e1fefcc82898/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.125238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea2b44585df476e85ec358922eb642e, user_id=8fd8f7ed0c644dd49207e1fefcc82898, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.128365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6899627-88be-44d0-8328-c16c0b671ee7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.150458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 927/1848] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:30.150656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 922/1849] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:30 2022] PUT /identity/v3/projects/8ea2b44585df476e85ec358922eb642e/users/8fd8f7ed0c644dd49207e1fefcc82898/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:30.157862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.159367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.161746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.162231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.170794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff541ae-98fb-4d01-8878-e0d2cf9511cd None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.230469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:30.236465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] MFA Rules not processed for user `8fd8f7ed0c644dd49207e1fefcc82898`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:30.237724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:30.270164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.272656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.273034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.273493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.275474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.279526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.343127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 928/1850] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:30.343127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.343664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:30.413804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 923/1851] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:30.418511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.425768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1162d2-4aad-4565-aa0f-d042df53bc18 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.433897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.436535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.437432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.437928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.452663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6d75d-123d-47b8-a33c-976d467b8104 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.566120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.567526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.568144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.569193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.571589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.576517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.596331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.599340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.628584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 929/1852] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:30.630225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.633575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 924/1853] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:30.636628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.649031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a7c78-73da-49a0-a7bd-bcc2049c5b5d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.654853 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.655585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.655936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.656321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.657046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.658978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.660166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e78bb1-f794-41b5-881e-6d61d056bd4d service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.671892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 925/1854] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:30.675822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.676763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.678039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.678563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.679182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.680634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.684901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.702180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3f325-0a99-4249-b214-9c53043837a4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.717764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.718655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.719377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.719657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.723042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.727126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.747781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 930/1855] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:30.752253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.765715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 926/1856] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:30.769076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.793213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d9a74-ad04-4da7-932a-15d0d70a4dd7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.862446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:30.869459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:30.891490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb43a1-1cfa-419f-8ee9-7041ff93c0d9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:30.893926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.894654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.894934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.895206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] PATH_INFO: `/v3/projects/882f1b2dd2824431a018dc4ae6e1eb48/users/5eced56719cf4841bb6304a5f9722403/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.898703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:30.900013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.900532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.901038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.904228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.907303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c868d4e-d2ca-49b2-aa3e-744343a5a3aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.914787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=882f1b2dd2824431a018dc4ae6e1eb48, user_id=5eced56719cf4841bb6304a5f9722403, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:30.918967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:30.944482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 927/1857] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:30 2022] PUT /identity/v3/projects/882f1b2dd2824431a018dc4ae6e1eb48/users/5eced56719cf4841bb6304a5f9722403/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:30.944816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 931/1858] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:30.946020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:30.950718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:30.953545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:30.954164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:30.994683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] MFA Rules not processed for user `5eced56719cf4841bb6304a5f9722403`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:30.996231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.048220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaab43-62e0-49ca-8a19-d225e9574854 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.060965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.062672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.064201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.065180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.067168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.071591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.098346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 928/1859] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:31.102653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.114891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb98f-5edd-4638-97b8-5feac0cf6d11 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.120846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.121840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.122213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.123100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] PATH_INFO: `/v3/projects/8d4faf7a21184dca8e9f3965a130506d/users/d25ef718b4df47a8a4f5f9fdc1d5d60c/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.140656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4faf7a21184dca8e9f3965a130506d, user_id=d25ef718b4df47a8a4f5f9fdc1d5d60c, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.144155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.156036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 932/1860] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:31.161091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.166314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 929/1861] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:31 2022] PUT /identity/v3/projects/8d4faf7a21184dca8e9f3965a130506d/users/d25ef718b4df47a8a4f5f9fdc1d5d60c/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:31.167489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.172855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d184e35-ff99-439c-aa6d-7e4e65f734db None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.238724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.239365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.239738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.239956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.240539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.242540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.251516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84d63f-edfd-4945-bb94-19697f142c78 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.256614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.257441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.257728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.258234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.258931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.260637 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.276084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 930/1862] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:31.276084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.278049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.283215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 933/1863] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:31 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:31.286507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.293174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eb751-6c46-4d15-8dea-166fad07dcea admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.320375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.353721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.354296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.354413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.354620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.354897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] PATH_INFO: `/v3/projects/6bd9a1bc030a4740a2830512e789c697` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.356115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd9a1bc030a4740a2830512e789c697)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.358312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.361017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f22cc-3d0b-4163-924d-acf6965445b2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.367105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.367790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.368236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.368500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] PATH_INFO: `/v3/projects/8d4faf7a21184dca8e9f3965a130506d/users/d25ef718b4df47a8a4f5f9fdc1d5d60c/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.370881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4faf7a21184dca8e9f3965a130506d, user_id=d25ef718b4df47a8a4f5f9fdc1d5d60c, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.373749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.389487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 934/1864] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:31 2022] PUT /identity/v3/projects/8d4faf7a21184dca8e9f3965a130506d/users/d25ef718b4df47a8a4f5f9fdc1d5d60c/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:31.389487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.423782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd9a1bc030a4740a2830512e789c697', 'request_id': 'req-8af29541-b99c-42cc-a940-de368d69441a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.431189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd9a1bc030a4740a2830512e789c697', 'request_id': 'req-8af29541-b99c-42cc-a940-de368d69441a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.438769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd9a1bc030a4740a2830512e789c697', 'request_id': 'req-8af29541-b99c-42cc-a940-de368d69441a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.457522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] The token cache is being invalidate because project 6bd9a1bc030a4740a2830512e789c697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:31.457925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.459323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8af29541-b99c-42cc-a940-de368d69441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.461431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 931/1865] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:31 2022] DELETE /identity/v3/projects/6bd9a1bc030a4740a2830512e789c697 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:31.463184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.463585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.463929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.475793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c210-c081-4cbe-8164-59a75ce519b9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.493136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] MFA Rules not processed for user `d25ef718b4df47a8a4f5f9fdc1d5d60c`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:31.494434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.555103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.556090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.556518 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.556969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.557848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.561040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.572069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 932/1866] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:31.573227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.585744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.592834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 935/1867] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:31 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:31.593808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.595787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.602396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d9153-92e5-45cf-a988-ea9d7bee3f22 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.609509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.611456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.611904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.612187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] PATH_INFO: `/v3/users/5142d472c3134ca194ab702734889e42` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.613708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5142d472c3134ca194ab702734889e42)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.617221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.673781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.693895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5142d472c3134ca194ab702734889e42'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.716345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98266b-a0ea-4cad-8d67-9cb5da42b960 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.716442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5142d472c3134ca194ab702734889e42'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.720668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.721657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.722384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.722384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.724951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.731066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5142d472c3134ca194ab702734889e42'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.745131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.747987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.758586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5142d472c3134ca194ab702734889e42'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.761336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5142d472c3134ca194ab702734889e42'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:31.773973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 936/1868] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:31.775376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.778243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:31.804677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 933/1869] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:31 2022] DELETE /identity/v3/users/5142d472c3134ca194ab702734889e42 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:31.814934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826582b5-8aca-4966-ad0f-8bcf3c46bef5 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:31.857576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:31.935910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:31.938769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:31.945278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:31.945607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:31.946332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:31.948867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:31.976923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 937/1870] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:31.981809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:31.995416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5404100-aa40-407d-9dc0-b2fc443656af admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.001188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.002061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.002496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.002984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] PATH_INFO: `/v3/projects/3d43e110fe634b33b63ab05e657ddcae/users/dfecc49ec75542fbbe27855b11209bbc/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.030984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d43e110fe634b33b63ab05e657ddcae, user_id=dfecc49ec75542fbbe27855b11209bbc, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.035877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.063473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 934/1871] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:31 2022] PUT /identity/v3/projects/3d43e110fe634b33b63ab05e657ddcae/users/dfecc49ec75542fbbe27855b11209bbc/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:32.065023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.078018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d54ca8-98d0-48d5-af3c-fafaad8de79f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.188126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.189876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.190366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.190689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.191411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.193784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426a4bb3-acd5-48ed-a399-b1efec4020d6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.212189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 938/1872] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:32.216443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.243648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36bc26-fd44-4eff-aad0-dd9adad3ff51 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.253631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.255111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.255111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.255344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] PATH_INFO: `/v3/projects/3d43e110fe634b33b63ab05e657ddcae/users/dfecc49ec75542fbbe27855b11209bbc/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.257735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d43e110fe634b33b63ab05e657ddcae, user_id=dfecc49ec75542fbbe27855b11209bbc, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.261363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.277447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 935/1873] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:32 2022] PUT /identity/v3/projects/3d43e110fe634b33b63ab05e657ddcae/users/dfecc49ec75542fbbe27855b11209bbc/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:32.288198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.288579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.288965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.364373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] MFA Rules not processed for user `dfecc49ec75542fbbe27855b11209bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:32.368215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.454359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.457584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.524082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 939/1874] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:32.536532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.538254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.602202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db70f5b-01a9-42d3-bc2a-778f148aa303 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.608619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.609605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.609746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.610010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] PATH_INFO: `/v3/projects/dd0188f35c58495495b93261c3e0ab51` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.611750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd0188f35c58495495b93261c3e0ab51)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.613671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.617016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:32.625284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a8b2a-e818-4b36-a940-31a30dcdc772 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.631693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.631923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.637307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.637307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.654277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.656306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c797b-baa1-4fdd-bacf-25151ecb25fa service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.672819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd0188f35c58495495b93261c3e0ab51', 'request_id': 'req-7d6ccf8f-43df-439d-9709-68f7e3eca92b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.673164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 940/1875] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:32.686951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd0188f35c58495495b93261c3e0ab51', 'request_id': 'req-7d6ccf8f-43df-439d-9709-68f7e3eca92b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.701506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd0188f35c58495495b93261c3e0ab51', 'request_id': 'req-7d6ccf8f-43df-439d-9709-68f7e3eca92b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.721748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] The token cache is being invalidate because project dd0188f35c58495495b93261c3e0ab51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:32.722199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.722897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.729484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 936/1876] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:32 2022] DELETE /identity/v3/projects/dd0188f35c58495495b93261c3e0ab51 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:32.730100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.730389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.730666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.746562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.748265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.757346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:32.758588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.758831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:32.866653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ccf8f-43df-439d-9709-68f7e3eca92b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.872684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 941/1877] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:32.874301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:32.878952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:32.882024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.883718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.884314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.885526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] PATH_INFO: `/v3/users/8fd8f7ed0c644dd49207e1fefcc82898` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.888974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd8f7ed0c644dd49207e1fefcc82898)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:32.891177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:32.952705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd8f7ed0c644dd49207e1fefcc82898'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.968331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd8f7ed0c644dd49207e1fefcc82898'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.969105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd8f7ed0c644dd49207e1fefcc82898'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.975989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adf460-1f43-40f7-9a43-e766fad1f4ba None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:32.982620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd8f7ed0c644dd49207e1fefcc82898'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.983325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6a4d19f6-7081-4c87-be86-cd6d5f91e8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd8f7ed0c644dd49207e1fefcc82898'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:32.984031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:32.984908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:32.985093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:32.985575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:32.988276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.001444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 937/1878] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:32 2022] DELETE /identity/v3/users/8fd8f7ed0c644dd49207e1fefcc82898 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:33.001444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.001444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.001851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.027781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:33.029010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.060908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.062376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae0d00-08f4-4230-916d-f9bb8b7c3945 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.071776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 942/1879] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:33.073022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.073309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.073615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.092621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 938/1880] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:33.092773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:33.093971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.097230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.102088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 943/1881] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:33.110507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab51ebe-93ac-4442-826e-e295baff5486 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.112000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.112938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.115617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.116592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.116959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.117469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.118264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:33.118687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.120820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.134943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 939/1882] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:33.139138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.152613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebffa6-4d20-4f4e-a030-694cfcc4b1a4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.158557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.159211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.159636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.160392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.161304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.162115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:33.164133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.179408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:33.181855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ba64-e912-4bc0-b0b4-818b4ece8045 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.186084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.186756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.187136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.187418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.205117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.206326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.221171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 940/1883] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:33.221317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 944/1884] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:33.222299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.307406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df597117-21d6-465e-b424-14725f3a7548 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.316964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.317756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.318204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.318760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.319550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.322252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.353069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 941/1885] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:33.354118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.364511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8225b-72f8-4a1c-88b2-e5a3388420de service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.369511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.370207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.370563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.370910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.371638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.373443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.391233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 945/1886] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:33.392679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.404603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329d38d-0f12-4371-9d3d-fe4bf6e35f57 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.421291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.421957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.422239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.422515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.423171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.424781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c115f-96f3-47eb-86f2-94356db902f9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.436392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 942/1887] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:33.440418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.450434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818a7e4-e768-4384-9866-e3e644384665 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.455111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.455845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.456129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.456401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] PATH_INFO: `/v3/projects/eecc67fbda6241f38270d61e3956e6c6/users/4746be6a8663435fb3fc069e5e202427/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.472318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecc67fbda6241f38270d61e3956e6c6, user_id=4746be6a8663435fb3fc069e5e202427, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.475067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.489201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 946/1888] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:33 2022] PUT /identity/v3/projects/eecc67fbda6241f38270d61e3956e6c6/users/4746be6a8663435fb3fc069e5e202427/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:33.501223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.501578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.501870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.537500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.540626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.551763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] MFA Rules not processed for user `4746be6a8663435fb3fc069e5e202427`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:33.553030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.652037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ed3da-d2b7-4c90-9fdb-831970d070ef admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.657135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.657997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.658344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.658682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] PATH_INFO: `/v3/projects/8ea2b44585df476e85ec358922eb642e` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.661662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea2b44585df476e85ec358922eb642e)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.664014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.680301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 943/1889] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:33.684876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.702666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa8e83-4692-45f1-b629-d648bc3dafc0 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.708307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.709072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.709352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.709876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.710595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.713120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.770234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 944/1890] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/projects => generated 391 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:33.770234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.779975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea2b44585df476e85ec358922eb642e', 'request_id': 'req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:33.792438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea2b44585df476e85ec358922eb642e', 'request_id': 'req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:33.817072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea2b44585df476e85ec358922eb642e', 'request_id': 'req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:33.849696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] The token cache is being invalidate because project 8ea2b44585df476e85ec358922eb642e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:33.850020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:33.852950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:33.854203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:33.857034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 947/1891] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:33 2022] DELETE /identity/v3/projects/8ea2b44585df476e85ec358922eb642e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:33.861553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.865621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.895545 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d55bb2-7530-4d24-a0e9-a21820f7636c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.903829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.904433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.904712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.905027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.905697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.908306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.939303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:33.946998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 945/1892] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:33 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:33.951920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.954787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:33.967778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d35aca-46c6-4576-a1dc-dd24290f4b61 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.972605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.973223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.973530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.973798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.974447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:33.976256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:33.978878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfc7b0-faec-4471-be9b-b1fdb7e0fe0a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:33.990045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 946/1893] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:33.991631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:33.993015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:33.994149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:33.994432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:33.994702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] PATH_INFO: `/v3/users/d25ef718b4df47a8a4f5f9fdc1d5d60c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:33.998486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d25ef718b4df47a8a4f5f9fdc1d5d60c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.002169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.005611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019f79-a9be-46dd-81da-a4c018d6c077 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.012503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.013201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.013574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.014035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] PATH_INFO: `/v3/projects/6120dc3e54a54c36bd46891cb755db13/users/fbc5fce4937d43699de64b4430ff6601/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.063368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6120dc3e54a54c36bd46891cb755db13, user_id=fbc5fce4937d43699de64b4430ff6601, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.066340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.076596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd25ef718b4df47a8a4f5f9fdc1d5d60c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.082671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 947/1894] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:33 2022] PUT /identity/v3/projects/6120dc3e54a54c36bd46891cb755db13/users/fbc5fce4937d43699de64b4430ff6601/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:34.089873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.094858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd25ef718b4df47a8a4f5f9fdc1d5d60c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.153423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd25ef718b4df47a8a4f5f9fdc1d5d60c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.155219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd25ef718b4df47a8a4f5f9fdc1d5d60c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.174144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd25ef718b4df47a8a4f5f9fdc1d5d60c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.181495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 948/1895] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:33 2022] DELETE /identity/v3/users/d25ef718b4df47a8a4f5f9fdc1d5d60c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:34.237658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7bb49-6e30-4029-b801-761a820c04f2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.308848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.309924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.310281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.310724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.312136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.313881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718f887-3b31-4c41-b055-1e0c9caa6477 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.327186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 948/1896] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:34.331697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.333232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.357786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cc5ac-1c9c-4cc4-99b2-f97f12e77d31 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.367636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.368508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.368831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.369124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] PATH_INFO: `/v3/projects/6120dc3e54a54c36bd46891cb755db13/users/fbc5fce4937d43699de64b4430ff6601/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.371411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6120dc3e54a54c36bd46891cb755db13, user_id=fbc5fce4937d43699de64b4430ff6601, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.374123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.388071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 949/1897] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:34 2022] PUT /identity/v3/projects/6120dc3e54a54c36bd46891cb755db13/users/fbc5fce4937d43699de64b4430ff6601/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:34.398459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.398883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.398987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.434254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] MFA Rules not processed for user `fbc5fce4937d43699de64b4430ff6601`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:34.435521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.471723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:34.497750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.500139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.566408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 949/1898] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:34.577831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.579233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.635744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d9c8d-06c8-42fa-bef3-f22e70b9eab1 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.651370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.652033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.652314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.653310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] PATH_INFO: `/v3/projects/8d4faf7a21184dca8e9f3965a130506d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.655697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4faf7a21184dca8e9f3965a130506d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.657929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.691502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972165fe-9bbd-4426-bb3f-06d910461a1e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.695221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.695841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.696120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.696392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.707377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.708876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c6d54-39c1-4435-97a5-a792e5c54890 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.718699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:34.721484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 950/1899] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:34.724686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4faf7a21184dca8e9f3965a130506d', 'request_id': 'req-cbf8f026-0b80-435f-ba94-37366873f77c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.735306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4faf7a21184dca8e9f3965a130506d', 'request_id': 'req-cbf8f026-0b80-435f-ba94-37366873f77c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.756535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4faf7a21184dca8e9f3965a130506d', 'request_id': 'req-cbf8f026-0b80-435f-ba94-37366873f77c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.772500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] The token cache is being invalidate because project 8d4faf7a21184dca8e9f3965a130506d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:34.772966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.774055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:34.779508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 950/1900] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:34 2022] DELETE /identity/v3/projects/8d4faf7a21184dca8e9f3965a130506d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:34.781021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0ac0f-25ea-413d-b3ca-b8fb8a000fae None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.781542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0ac0f-25ea-413d-b3ca-b8fb8a000fae None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.782204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0ac0f-25ea-413d-b3ca-b8fb8a000fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.794383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.796221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.806466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-1bf0ac0f-25ea-413d-b3ca-b8fb8a000fae None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:34.807906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1bf0ac0f-25ea-413d-b3ca-b8fb8a000fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.892773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8f026-0b80-435f-ba94-37366873f77c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.894157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 951/1901] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:34.898355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.898998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.899277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.899550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.901770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.903116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.903407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.903686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.928345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:34.929828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:34.940428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 952/1902] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:34.944683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:34.956225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092cdda-7bb1-44c3-9b83-dd495394eaa9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:34.963383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:34.964005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:34.964284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:34.964558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:34.965211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:34.965559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.967407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.974804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:34.976321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:34.981076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 953/1903] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:21:34.989357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 951/1904] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:34 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:34.995008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.005068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b52ce1-f642-49ea-9df1-92199585df05 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.009817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.010442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.010719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.010989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.011620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.013557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.045601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 954/1905] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:34 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:35.047095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.057993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801adacf-f777-4232-87a7-edd8dfe0dcea service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.116393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.117002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.117281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.117588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.118232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.120187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.148577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 952/1906] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:35 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:35.149876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.162760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71aabce-3aad-426b-8164-5a107ff21394 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.167683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.168216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.168490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.168759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.169566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.171944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.203828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 955/1907] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:35.205236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.220544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eff1f7-8391-4214-ac8a-caf4c3430564 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.226746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.228800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.228800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.229115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.229995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.232200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b394ee5-c4a2-4f08-9aff-ce6e37c06907 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.249866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 953/1908] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:35.252239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.274973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7253c7-7efe-4f6b-bf4a-cbe1d27b8b37 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.290119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.292484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.292761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.293028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] PATH_INFO: `/v3/projects/c5259ec1e6204c329c5a1d01b314a94a/users/780f162ebcec42c6adc0ff566fbf81a1/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.315967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:35.334135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5259ec1e6204c329c5a1d01b314a94a, user_id=780f162ebcec42c6adc0ff566fbf81a1, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.337197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.366130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 956/1909] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:35 2022] PUT /identity/v3/projects/c5259ec1e6204c329c5a1d01b314a94a/users/780f162ebcec42c6adc0ff566fbf81a1/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:35.366821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.367109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.367383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.389467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:35.414666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] MFA Rules not processed for user `780f162ebcec42c6adc0ff566fbf81a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:35.415900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:35.487737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 954/1910] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:35.494339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.578871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c4d9-d276-40cf-b910-0e5542ff5dcb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.583985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.584602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.584884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.585157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.585836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.588218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.620910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 957/1911] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:35 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:35.624893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.647633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78d9c6-4a89-4015-aca6-55696abda478 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.723909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.724585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.724865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.725145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.725858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.728272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.754636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 955/1912] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:35 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:35.758543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.773722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0323f-0a09-4683-b9a8-17a775a6d82f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.779929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.779929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.780183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.780504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.781209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.783573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.797812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 958/1913] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:35.802462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.814178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6486eb8d-c79f-4c39-91db-bc95a15df7c2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.819486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.820594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.821036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.821801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] PATH_INFO: `/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f/users/09b099c305cd4be2bff982537f7909d9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.843028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edd93d9a7e34dc2aa09fa8a7db22c8f, user_id=09b099c305cd4be2bff982537f7909d9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.846217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.873057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 956/1914] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:35 2022] PUT /identity/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f/users/09b099c305cd4be2bff982537f7909d9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:35.882758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:35.899014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb21a57-27da-47d0-9e3d-b7c4345ab626 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:35.981573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:35.981573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:35.981573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:35.981573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:35.981988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:35.981988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:35.999288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 959/1915] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:36.003191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:36.019905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d29860-a435-4cb8-b33c-c7571e1fb891 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:36.021412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:36.023856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:36.024167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:36.024624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.025000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.025309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] PATH_INFO: `/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f/users/09b099c305cd4be2bff982537f7909d9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.027503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edd93d9a7e34dc2aa09fa8a7db22c8f, user_id=09b099c305cd4be2bff982537f7909d9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:36.031226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b252b70-b930-4d81-beff-457463dfa392 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:36.042691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d442cc-6bab-441b-81d1-dc2e0926177f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:36.043106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 957/1916] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:36 2022] PUT /identity/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f/users/09b099c305cd4be2bff982537f7909d9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:36.054258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.054479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.054752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.095875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] MFA Rules not processed for user `09b099c305cd4be2bff982537f7909d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:36.098006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:36.117795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:36.125716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:36.126463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.126839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.127290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] PATH_INFO: `/v3/users/5eced56719cf4841bb6304a5f9722403` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.129445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eced56719cf4841bb6304a5f9722403)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:36.131582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:36.147912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:36.197675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eced56719cf4841bb6304a5f9722403'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:36.211168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 958/1917] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:36.220492 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:36.227073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eced56719cf4841bb6304a5f9722403'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:36.227800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eced56719cf4841bb6304a5f9722403'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:36.237065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eced56719cf4841bb6304a5f9722403'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:36.238044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2bae7eed-693d-41f2-a32a-b68dd188ad87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eced56719cf4841bb6304a5f9722403'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:36.262453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 960/1918] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:36 2022] DELETE /identity/v3/users/5eced56719cf4841bb6304a5f9722403 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:36.268338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.270023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.270486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.301552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:36.303220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:36.311088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14157067-a280-4f44-aacb-c5cf3846f531 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:36.393378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 961/1919] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:36.409589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:36.409589 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:36.438509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:36.439481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.439914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.441003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.444420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:36.525928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0e4c2-ceb6-47c0-8ead-11aadd3cc13a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:36.535443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:36.536086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:36.536373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:36.536617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:36.550479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:36.553832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:36.564107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:36.565598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:36.568547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 962/1920] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:36.593754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 959/1921] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:37.381800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:37.384064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:37.421060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb199d2b-0e50-47a6-8b3d-fb8c3584c695 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:37.432813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:37.433494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:37.433915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:37.434188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] PATH_INFO: `/v3/projects/882f1b2dd2824431a018dc4ae6e1eb48` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:37.437220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=882f1b2dd2824431a018dc4ae6e1eb48)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:37.439095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:37.460293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:37.516288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882f1b2dd2824431a018dc4ae6e1eb48', 'request_id': 'req-1b42a143-ac91-4b42-9679-0cca11d9b564'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.524376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882f1b2dd2824431a018dc4ae6e1eb48', 'request_id': 'req-1b42a143-ac91-4b42-9679-0cca11d9b564'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.535034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882f1b2dd2824431a018dc4ae6e1eb48', 'request_id': 'req-1b42a143-ac91-4b42-9679-0cca11d9b564'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.564442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] The token cache is being invalidate because project 882f1b2dd2824431a018dc4ae6e1eb48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:37.564567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.565375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.567807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 963/1922] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:37 2022] DELETE /identity/v3/projects/882f1b2dd2824431a018dc4ae6e1eb48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:37.571462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:37.587142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6db096-1b9e-45ba-83b0-d7fe9644b5f6 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:37.675615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:37.705016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:37.705827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:37.706232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:37.706630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] PATH_INFO: `/v3/users/dfecc49ec75542fbbe27855b11209bbc` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:37.708122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfecc49ec75542fbbe27855b11209bbc)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:37.710254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:37.777070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfecc49ec75542fbbe27855b11209bbc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.785871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfecc49ec75542fbbe27855b11209bbc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.801246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfecc49ec75542fbbe27855b11209bbc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.802446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfecc49ec75542fbbe27855b11209bbc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.810964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-2d99d36d-ff1f-4d89-9015-5fc06ff13a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfecc49ec75542fbbe27855b11209bbc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:37.820586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 960/1923] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:37 2022] DELETE /identity/v3/users/dfecc49ec75542fbbe27855b11209bbc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:38.239243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:38.241332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:38.263826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42a143-ac91-4b42-9679-0cca11d9b564 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:38.434718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:38.435840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:38.436267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:38.436680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] PATH_INFO: `/v3/projects/3d43e110fe634b33b63ab05e657ddcae` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:38.440222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d43e110fe634b33b63ab05e657ddcae)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:38.443471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:38.630187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d43e110fe634b33b63ab05e657ddcae', 'request_id': 'req-ccf21206-eff3-4cca-9db7-9a769d876ef0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:38.644611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d43e110fe634b33b63ab05e657ddcae', 'request_id': 'req-ccf21206-eff3-4cca-9db7-9a769d876ef0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:38.657633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d43e110fe634b33b63ab05e657ddcae', 'request_id': 'req-ccf21206-eff3-4cca-9db7-9a769d876ef0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:38.681685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] The token cache is being invalidate because project 3d43e110fe634b33b63ab05e657ddcae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:38.682747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:38.684472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ccf21206-eff3-4cca-9db7-9a769d876ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:38.695996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 964/1924] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:38 2022] DELETE /identity/v3/projects/3d43e110fe634b33b63ab05e657ddcae => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:38.698025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:38.698892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:38.699344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:38.726457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:38.728581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:38.814278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 961/1925] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:38.833673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:38.834153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:38.834624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:38.875520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:38.877354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:38.886602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 965/1926] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:38.891437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:38.907405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee19009-169a-48f7-a71c-6c4f8e700d2a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:38.924320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:38.925629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:38.926069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:38.926507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:38.927322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:38.927761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:38.929733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:38.944590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 962/1927] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:38.949969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:38.962145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddac2f6-bd60-406c-b56e-84e57fb0bb13 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:38.967893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:38.968537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:38.975713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:38.983675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:38.984479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:38.986529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.035413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 966/1928] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:38 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:21:39.039854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.051205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba8181-c887-43a2-96b5-4aed2530f8c8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.131852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:39.161367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.163856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.164114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.164376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.168548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.174732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.207984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 963/1929] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:39 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:39.209304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.219764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:39.225243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b4b93-9596-4840-b53b-8c85508a7993 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.238971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.239830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.240149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.240427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.241961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.244849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.260727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 967/1930] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:39.264260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.275531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df1b6e-a13b-40d2-ad65-b5fd53428183 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.280934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.281610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.281892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.282164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.282846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.285641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.295103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.297435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.316079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 964/1931] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:39.317788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61911186-5897-47c9-95bc-02a1ee7341f1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.319443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.332198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.332414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf97ab8-2de5-4534-a6d6-8befd22d9a79 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.332986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.333332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.333810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] PATH_INFO: `/v3/users/4746be6a8663435fb3fc069e5e202427` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.335068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4746be6a8663435fb3fc069e5e202427)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.337286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.339627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.340622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.341171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.341745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] PATH_INFO: `/v3/projects/bcc715590f88432d9b6e7dd779ad5851/users/1bc3be23405d4ae88dd46d656ad6a3c8/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.365061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc715590f88432d9b6e7dd779ad5851, user_id=1bc3be23405d4ae88dd46d656ad6a3c8, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.369073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181247e8-9849-42ce-bf64-e47030297f82 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.387359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 965/1932] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:39 2022] PUT /identity/v3/projects/bcc715590f88432d9b6e7dd779ad5851/users/1bc3be23405d4ae88dd46d656ad6a3c8/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:39.392880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.393343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.393813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.396216 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4746be6a8663435fb3fc069e5e202427'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:39.411179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4746be6a8663435fb3fc069e5e202427'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:39.411951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4746be6a8663435fb3fc069e5e202427'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:39.417145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:39.418516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.420232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4746be6a8663435fb3fc069e5e202427'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:39.420860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a5c0d131-4103-4652-abc0-bf374dec262d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4746be6a8663435fb3fc069e5e202427'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:39.434472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 968/1933] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:39 2022] DELETE /identity/v3/users/4746be6a8663435fb3fc069e5e202427 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:39.439437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.440061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.440061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.461268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:39.462433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.490285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 966/1934] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:39.500282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.501889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.529217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 969/1935] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:39.539156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.540577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.571028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797f3ca-061d-4b43-863f-5888af8b5b0f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.613143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bc17c-49ed-4eaa-97cd-6da5ec1baf51 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.616961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.617829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.618107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.618378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.629819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.631608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.638591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.639320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.639817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.640087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.644485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 970/1936] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:39.652080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.653603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389715fc-9a49-4127-8e20-84b26214c129 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.665818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 967/1937] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:39.905585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:39.907456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:39.924872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48126-77ef-4103-94ee-7a68b60c335f service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:39.930823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:39.931831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:39.932295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:39.932796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] PATH_INFO: `/v3/users/780f162ebcec42c6adc0ff566fbf81a1` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:39.934736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780f162ebcec42c6adc0ff566fbf81a1)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:39.936897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:39.940699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:40.016394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780f162ebcec42c6adc0ff566fbf81a1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:40.045576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780f162ebcec42c6adc0ff566fbf81a1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:40.046631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780f162ebcec42c6adc0ff566fbf81a1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:40.063895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780f162ebcec42c6adc0ff566fbf81a1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:40.065496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780f162ebcec42c6adc0ff566fbf81a1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:40.087840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 971/1938] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:39 2022] DELETE /identity/v3/users/780f162ebcec42c6adc0ff566fbf81a1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:40.089879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:40.090392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:40.090747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:40.099247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:40.127304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:40.129291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:40.211303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 968/1939] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:40.243704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:40.245224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:40.379369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7357c0-605c-4a33-b0ba-95aab356a486 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:40.392197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:40.393140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:40.393446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:40.393726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:40.404127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:40.405649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:40.417173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 972/1940] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:40.903806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:40.903806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:40.915041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39858b1-c5f2-412b-9d36-a5238350b97c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:40.923369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:40.924274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:40.924472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:40.924717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] PATH_INFO: `/v3/projects/eecc67fbda6241f38270d61e3956e6c6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:40.934791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eecc67fbda6241f38270d61e3956e6c6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:40.936548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:41.036944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eecc67fbda6241f38270d61e3956e6c6', 'request_id': 'req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.057901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eecc67fbda6241f38270d61e3956e6c6', 'request_id': 'req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.068387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eecc67fbda6241f38270d61e3956e6c6', 'request_id': 'req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.089566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] The token cache is being invalidate because project eecc67fbda6241f38270d61e3956e6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:41.090039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.090864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.096550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 969/1941] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:40 2022] DELETE /identity/v3/projects/eecc67fbda6241f38270d61e3956e6c6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:41.097625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:41.107987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502fe91-052a-495d-a7a2-1f9dd6e7562a service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:41.185752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:41.186845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:41.187327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:41.187806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] PATH_INFO: `/v3/users/fbc5fce4937d43699de64b4430ff6601` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:41.189717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbc5fce4937d43699de64b4430ff6601)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:41.191988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:41.234787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:41.263885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbc5fce4937d43699de64b4430ff6601'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.285618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbc5fce4937d43699de64b4430ff6601'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.286821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbc5fce4937d43699de64b4430ff6601'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.296945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbc5fce4937d43699de64b4430ff6601'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.297626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbc5fce4937d43699de64b4430ff6601'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.345344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 973/1942] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:41 2022] DELETE /identity/v3/users/fbc5fce4937d43699de64b4430ff6601 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:41.662746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:41.664442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:41.678385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b319f2-ccc3-4aad-abc3-faf6ed5a9446 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:41.762208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:41.763593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:41.763969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:41.764921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] PATH_INFO: `/v3/projects/c5259ec1e6204c329c5a1d01b314a94a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:41.765681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5259ec1e6204c329c5a1d01b314a94a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:41.768098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:41.837369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:41.871725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5259ec1e6204c329c5a1d01b314a94a', 'request_id': 'req-427ea26b-0f8e-4888-96ba-1f397452590e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.884647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5259ec1e6204c329c5a1d01b314a94a', 'request_id': 'req-427ea26b-0f8e-4888-96ba-1f397452590e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.895886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5259ec1e6204c329c5a1d01b314a94a', 'request_id': 'req-427ea26b-0f8e-4888-96ba-1f397452590e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.913248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] The token cache is being invalidate because project c5259ec1e6204c329c5a1d01b314a94a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:41.913679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.914980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-427ea26b-0f8e-4888-96ba-1f397452590e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:41.921632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 970/1943] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:41 2022] DELETE /identity/v3/projects/c5259ec1e6204c329c5a1d01b314a94a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:41.921923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:41.928412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:41.958498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1387ec9-38e1-4253-9d3b-9892b7e0d9c1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.004279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.004722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.004824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.046598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] MFA Rules not processed for user `1bc3be23405d4ae88dd46d656ad6a3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:42.049156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.061382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.062135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.062415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.062686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] PATH_INFO: `/v3/users/09b099c305cd4be2bff982537f7909d9` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.064461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b099c305cd4be2bff982537f7909d9)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.066982 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.148755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b099c305cd4be2bff982537f7909d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.172770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b099c305cd4be2bff982537f7909d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.175580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 971/1944] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:42.176582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.179300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.179558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b099c305cd4be2bff982537f7909d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.190727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b099c305cd4be2bff982537f7909d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.192608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b099c305cd4be2bff982537f7909d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.208528 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a16b4-22e9-46ce-80df-90e69a273480 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.213658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 974/1945] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:41 2022] DELETE /identity/v3/users/09b099c305cd4be2bff982537f7909d9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:42.213658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.223238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.257374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:42.357481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba171f-f5d3-4769-9ed9-71ca028f5c53 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.362473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.363407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.363690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.363961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] PATH_INFO: `/v3/projects/6120dc3e54a54c36bd46891cb755db13` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.365298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6120dc3e54a54c36bd46891cb755db13)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.367679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.369086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.370477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.371969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.372559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.375090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.380123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.428599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:42.431694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6120dc3e54a54c36bd46891cb755db13', 'request_id': 'req-7f431b0e-043a-490a-8ec8-a949ec2a4146'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.446878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6120dc3e54a54c36bd46891cb755db13', 'request_id': 'req-7f431b0e-043a-490a-8ec8-a949ec2a4146'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.457822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6120dc3e54a54c36bd46891cb755db13', 'request_id': 'req-7f431b0e-043a-490a-8ec8-a949ec2a4146'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.477468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] The token cache is being invalidate because project 6120dc3e54a54c36bd46891cb755db13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:42.477468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.477468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7f431b0e-043a-490a-8ec8-a949ec2a4146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.478117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 975/1946] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/projects => generated 371 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:42.479697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.482925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 972/1947] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:42 2022] DELETE /identity/v3/projects/6120dc3e54a54c36bd46891cb755db13 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:42.484041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.490333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85d6e-52b6-4512-99a3-dbd1b1959d92 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.491645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85d6e-52b6-4512-99a3-dbd1b1959d92 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.494107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85d6e-52b6-4512-99a3-dbd1b1959d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.524925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-eee85d6e-52b6-4512-99a3-dbd1b1959d92 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:42.526450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-eee85d6e-52b6-4512-99a3-dbd1b1959d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.644455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591e768-f5c2-46f9-aa03-0dede27eec3e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.651607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.652402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.652688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.652964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.653936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.656172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 973/1948] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:42.661678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.662440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.662555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.663042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.695685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 976/1949] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:42.701687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.722691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:42.726533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.729603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9a07-7114-482d-9c6c-2f051e4db496 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.743096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 974/1950] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:42.744035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.745369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.746517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.747280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.747639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.748166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.749049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.750962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.763842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d908330-be8f-4aed-814c-f1e169766243 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.769548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.770400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.770747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.771095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] PATH_INFO: `/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.772342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edd93d9a7e34dc2aa09fa8a7db22c8f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.774554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.788410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 977/1951] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:42.791532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.812026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1695b5-6ada-4d07-8737-b310ba9dd901 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.826452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:42.828284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:42.828781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:42.829686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:42.831005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:42.831515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:42.836731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:42.862149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 978/1952] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:42.865261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.865806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edd93d9a7e34dc2aa09fa8a7db22c8f', 'request_id': 'req-d6a7db8c-f71c-4774-9a0a-5338bc115afb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.874969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edd93d9a7e34dc2aa09fa8a7db22c8f', 'request_id': 'req-d6a7db8c-f71c-4774-9a0a-5338bc115afb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.884500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edd93d9a7e34dc2aa09fa8a7db22c8f', 'request_id': 'req-d6a7db8c-f71c-4774-9a0a-5338bc115afb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.884808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1280d-69c8-4d53-95ff-21156c858182 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:42.902502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] The token cache is being invalidate because project 0edd93d9a7e34dc2aa09fa8a7db22c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:42.902846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.903751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:42.911142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 975/1953] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:42 2022] DELETE /identity/v3/projects/0edd93d9a7e34dc2aa09fa8a7db22c8f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:42.911142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:42.911142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:42.980811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:42.998989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7db8c-f71c-4774-9a0a-5338bc115afb admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.004671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.005629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.005981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.006327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.007034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.009042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c425a-3864-4a7c-9629-d04ac4211ca5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.024768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.025629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.025916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.026194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] PATH_INFO: `/v3/projects/e25aa725759446189483213bcb765eb2/users/034af51e97114888b182417898d7ca5f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.058705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 976/1954] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:42 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:43.060149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.060683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.061032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.066004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25aa725759446189483213bcb765eb2, user_id=034af51e97114888b182417898d7ca5f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.069901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.081132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:43.099570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 979/1955] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:42 2022] PUT /identity/v3/projects/e25aa725759446189483213bcb765eb2/users/034af51e97114888b182417898d7ca5f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:43.100300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.105078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:43.108965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:43.197604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 977/1956] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:43.198247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03ec7-c166-4491-8926-d78e6e7825af admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.198834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.200832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:43.204232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.204936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.205287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.205662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.206377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.208809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c5be7-7fdd-45e2-adcd-3f2ab9fc8b5c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.214555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08c296-7d41-47d6-9827-62d30a442022 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.219899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.220752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.221041 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.221316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.222527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.223637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.234465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 980/1957] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:43.235875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.236264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.236660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.241233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 978/1958] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:43.242559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.254982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d0da8-88cb-42a9-a6fd-6433ad506584 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.260147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.260774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.261586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.261586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.261984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.264284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.266769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:43.268443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:43.277184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 981/1959] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:43.278226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.283443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 979/1960] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:43.283443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.289320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651233b4-d514-4dbe-9602-5b8695c2434d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.297719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.298699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.299731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.300174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] PATH_INFO: `/v3/projects/e25aa725759446189483213bcb765eb2/users/034af51e97114888b182417898d7ca5f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.303058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25aa725759446189483213bcb765eb2, user_id=034af51e97114888b182417898d7ca5f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.306910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.308205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5e2f5-d8f4-4c0a-8a18-94d2345908f6 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.323597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.323918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.324196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.324457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.325118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:43.329194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 982/1961] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:43 2022] PUT /identity/v3/projects/e25aa725759446189483213bcb765eb2/users/034af51e97114888b182417898d7ca5f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:43.331383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.342817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.344747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.375824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 980/1962] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:43.377232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.412141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c4a84-9ce5-4402-9710-7c56d2c26281 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.454808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c623d7f-b7f6-4cca-a874-8cbcb7fb686b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.461255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.462069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.462444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.462771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.463475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.466197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.481280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 983/1963] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:43.488956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.506292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04b80d-71c2-4d98-ae72-4118998a471f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.513248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.514562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.514938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.515688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] PATH_INFO: `/v3/projects/ba8f33ef157b40888c23bded7defa21a/users/eccbc1e60f3242e1bbbb1e583a3585fa/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.537584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.538670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.539162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.539532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.540762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.541987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8f33ef157b40888c23bded7defa21a, user_id=eccbc1e60f3242e1bbbb1e583a3585fa, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.543664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.545678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de01e98-f883-4b98-8f76-146a8a82ff45 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.565634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 984/1964] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:43 2022] PUT /identity/v3/projects/ba8f33ef157b40888c23bded7defa21a/users/eccbc1e60f3242e1bbbb1e583a3585fa/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:43.584671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.584954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.585607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.594208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 981/1965] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:43.602297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.631701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] MFA Rules not processed for user `eccbc1e60f3242e1bbbb1e583a3585fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:43.633672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:43.652789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:43.691837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:43.720358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f06dc-2f61-4c02-8321-0f9f1ab57000 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.726728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.727986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.728334 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.728682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.730200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.732561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.778644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 982/1966] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:43.786590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.789865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 985/1967] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:43.801455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9efe94-c720-4d29-86b9-d477976d7675 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.808232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.810396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:43.840469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.842163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.842690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.843181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.844346 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.846644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.872773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 983/1968] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:43.876684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.898756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf1156-06dc-4008-9118-b97ea0d9167f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.908704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.917376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.917999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.918495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.921195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.924318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.932496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9958a-1a17-45eb-943b-45d96a30fefa None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.938027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.939046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.939461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.940303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.943861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 984/1969] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:21:43.945171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:43.954314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:43.956065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:43.961352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a9e4e-4e23-4c6f-a42a-c38285a6f2ed admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:43.969630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 986/1970] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:43.973771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:43.974611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:43.975104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:43.975738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] PATH_INFO: `/v3/projects/6b0a4d941b154b08bd85eaa1f3ebc227/users/bee9df84552f477484def034029481fe/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:43.994759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:44.006032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0a4d941b154b08bd85eaa1f3ebc227, user_id=bee9df84552f477484def034029481fe, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:44.009029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71a3410-2735-4dc6-846c-cc01058e19f5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:44.009910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19066b1-713a-4b2c-a5fe-572046d5077d service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:44.017911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:44.018784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:44.019186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:44.019600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] PATH_INFO: `/v3/users/eccbc1e60f3242e1bbbb1e583a3585fa` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:44.021529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eccbc1e60f3242e1bbbb1e583a3585fa)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:44.027422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:44.041892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 985/1971] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:43 2022] PUT /identity/v3/projects/6b0a4d941b154b08bd85eaa1f3ebc227/users/bee9df84552f477484def034029481fe/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:44.045457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:44.045457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:44.045720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:44.119684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] MFA Rules not processed for user `bee9df84552f477484def034029481fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:44.120974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:44.141298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eccbc1e60f3242e1bbbb1e583a3585fa'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:44.164874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eccbc1e60f3242e1bbbb1e583a3585fa'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:44.165730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eccbc1e60f3242e1bbbb1e583a3585fa'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:44.175859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eccbc1e60f3242e1bbbb1e583a3585fa'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:44.176686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ea322c71-b8ef-4ab3-9d1f-93993be51282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eccbc1e60f3242e1bbbb1e583a3585fa'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:44.221061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 987/1972] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:43 2022] DELETE /identity/v3/users/eccbc1e60f3242e1bbbb1e583a3585fa => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:44.222953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:44.223913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:44.224026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:44.260523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:44.261677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 986/1973] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:44.263143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:44.278408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:44.280080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:44.325293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:44.369633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 988/1974] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:44.399702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:44.402345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:44.423199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248069-cac9-4d32-a792-c44e1200bb52 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:44.442961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:44.511614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:44.512264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:44.512547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:44.512818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:44.543063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d10db5-a025-4aa1-8b69-dbc41720a501 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:44.555477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:44.556142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:44.556419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:44.556686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:44.579656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:44.581138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41161aae-5390-47fd-baab-c56871e655a0 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:44.617074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 989/1975] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:44.627146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:44.629003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:44.643505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 987/1976] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:45.475301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341d20-6d95-4595-902f-689e9b9186d5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:45.475889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341d20-6d95-4595-902f-689e9b9186d5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:45.475889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341d20-6d95-4595-902f-689e9b9186d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:45.509246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-94341d20-6d95-4595-902f-689e9b9186d5 None None] MFA Rules not processed for user `034af51e97114888b182417898d7ca5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:45.511695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-94341d20-6d95-4595-902f-689e9b9186d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:45.655370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:45.657623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:45.681371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 990/1977] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:45.691892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:45.692380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:45.692689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:45.695352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05753f-0cd4-44a7-97d1-f9a4c4b5683e service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:45.704686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:45.705800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:45.706172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:45.706538 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] PATH_INFO: `/v3/projects/ba8f33ef157b40888c23bded7defa21a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:45.708118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8f33ef157b40888c23bded7defa21a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:45.710485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:45.733917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] MFA Rules not processed for user `1bc3be23405d4ae88dd46d656ad6a3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:45.735231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:45.791152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8f33ef157b40888c23bded7defa21a', 'request_id': 'req-391a2bc3-61db-4fa7-bed2-031e105b75ab'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:45.806813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8f33ef157b40888c23bded7defa21a', 'request_id': 'req-391a2bc3-61db-4fa7-bed2-031e105b75ab'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:45.816159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8f33ef157b40888c23bded7defa21a', 'request_id': 'req-391a2bc3-61db-4fa7-bed2-031e105b75ab'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:45.834428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 991/1978] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:45.841509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] The token cache is being invalidate because project ba8f33ef157b40888c23bded7defa21a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:45.842096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:45.843221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-391a2bc3-61db-4fa7-bed2-031e105b75ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:45.847476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 988/1979] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:45 2022] DELETE /identity/v3/projects/ba8f33ef157b40888c23bded7defa21a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:45.848716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:45.855447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de943-03f3-4dcb-b278-eda0bc86c703 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:45.855739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:45.856704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de943-03f3-4dcb-b278-eda0bc86c703 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:45.857856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de943-03f3-4dcb-b278-eda0bc86c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:45.888597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:45.889717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f59de943-03f3-4dcb-b278-eda0bc86c703 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:45.891350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f59de943-03f3-4dcb-b278-eda0bc86c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:45.953619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:45.961092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0fbdb-a16d-41c1-9d82-2c170efd097d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:45.968668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 989/1980] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:45.976994 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:45.977217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:45.977379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:45.999114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:46.000350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:46.008679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 990/1981] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:46.013021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.022665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40fd9-7c27-43e7-a042-fb63c9e56b05 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.027914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.028619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.028945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.029227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.029932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:46.030257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.031871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.042060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.042809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.043131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.043465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.045308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:46.049633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 991/1982] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:21:46.050682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.061287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d222344-b500-4ce8-b085-d192f0814beb admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.068025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.068649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.068985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.069365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.070566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.072892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.131504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 992/1983] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:46 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:46.133273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.159009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.165541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.181744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 992/1984] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:46.297388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb709184-5f1c-4a8c-a2bf-821f8f10ca22 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.302911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.303566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.303946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.304596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.305150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.308157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.341495 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 993/1985] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:46 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:46.343124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.371594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527676cd-ab6d-4eeb-8227-37a1689a72cc service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.384139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.386549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.387732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.388103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.389063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.391086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.413419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 993/1986] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:46.417734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.428997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489cd2-4a01-4105-821c-1907246db64b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.434321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.435314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.435639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.435911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.436570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.439135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0842-38f1-4b5a-968d-45f798aefc71 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.459673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 994/1987] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:46.461258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.473282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7b782-8c86-43d5-9f1d-c165b4b310c5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.477888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.478891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.478891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.479215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] PATH_INFO: `/v3/projects/74107e05cf1644fc805625368fca2cbb/users/3800f9c3071b4c908b4d378c69953228/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.496574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74107e05cf1644fc805625368fca2cbb, user_id=3800f9c3071b4c908b4d378c69953228, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.499657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.518855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 994/1988] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:46 2022] PUT /identity/v3/projects/74107e05cf1644fc805625368fca2cbb/users/3800f9c3071b4c908b4d378c69953228/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:46.529898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.532316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.532316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.576216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] MFA Rules not processed for user `3800f9c3071b4c908b4d378c69953228`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:46.577669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:46.686872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 995/1989] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:46.708173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:46.710783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:46.759742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:46.846905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2a364-d2c2-4444-ae4d-8dbac6180c46 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:46.851012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:46.852305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:46.852674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:46.853102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:46.882190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:46.883708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7df5f9-7f1c-4c5a-86e0-78c798767df5 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:46.912601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 995/1990] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:48.358488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:48.360756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:48.415851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:48.484463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa327137-5821-48c6-a5da-c598b5f24fee None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:48.489354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:48.490310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:48.491149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:48.492186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] PATH_INFO: `/v3/users/bee9df84552f477484def034029481fe` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:48.494152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee9df84552f477484def034029481fe)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:48.499367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:48.621296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3cc2-47ac-4da2-b13a-cec4dd79a875 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:48.622159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3cc2-47ac-4da2-b13a-cec4dd79a875 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:48.622159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3cc2-47ac-4da2-b13a-cec4dd79a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:48.642894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee9df84552f477484def034029481fe'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:48.660924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee9df84552f477484def034029481fe'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:48.661440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e0fd3cc2-47ac-4da2-b13a-cec4dd79a875 None None] MFA Rules not processed for user `3800f9c3071b4c908b4d378c69953228`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:48.663061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e0fd3cc2-47ac-4da2-b13a-cec4dd79a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:48.685223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 996/1991] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:48.696049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee9df84552f477484def034029481fe'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:48.697463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee9df84552f477484def034029481fe'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:48.713681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee9df84552f477484def034029481fe'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:48.721136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 996/1992] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:48 2022] DELETE /identity/v3/users/bee9df84552f477484def034029481fe => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:48.728888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:48.729551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:48.730102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:48.759301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:48.760605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:48.879191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 997/1993] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:48.901028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:48.904230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:49.006333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e685f-8023-44d3-9d7f-078e3dc2d4b6 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:49.020226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:49.022843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:49.023585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:49.024448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:49.041328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:49.043767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429e6c9c-f30b-429a-89a8-eec609165068 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:49.058203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 997/1994] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:21:50.928092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:50.935132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:51.001456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb99bd3-bbd1-44c3-bb56-5491aab6e7c6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:51.019658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:51.021747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:51.022367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:51.024626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] PATH_INFO: `/v3/projects/6b0a4d941b154b08bd85eaa1f3ebc227` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:51.029502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0a4d941b154b08bd85eaa1f3ebc227)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:51.031787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:51.135198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0a4d941b154b08bd85eaa1f3ebc227', 'request_id': 'req-7c896cc7-67b9-4fb4-9292-863efb9a89f6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:51.163603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0a4d941b154b08bd85eaa1f3ebc227', 'request_id': 'req-7c896cc7-67b9-4fb4-9292-863efb9a89f6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:51.175539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0a4d941b154b08bd85eaa1f3ebc227', 'request_id': 'req-7c896cc7-67b9-4fb4-9292-863efb9a89f6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:51.231795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] The token cache is being invalidate because project 6b0a4d941b154b08bd85eaa1f3ebc227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:51.232469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:51.248946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c896cc7-67b9-4fb4-9292-863efb9a89f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:51.255371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 998/1995] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:50 2022] DELETE /identity/v3/projects/6b0a4d941b154b08bd85eaa1f3ebc227 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:51.257693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:51.258628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:51.259074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:51.296944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:51.298803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:51.379400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:51.405628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 998/1996] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:51.420770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:51.421733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:51.422452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:51.457418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:51.459943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:51.497871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 999/1997] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:51.499532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:51.539803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5ce5f-a9b2-4f31-8042-51bf03579f08 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:51.558645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:51.562194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:51.562951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:51.563545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:51.565195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:51.566027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:51.571925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:51.639518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:51.662792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 999/1998] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:51.678777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7721d-2429-457d-b59e-985286df38d8 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:51.692970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:51.694490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:51.695244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:51.696040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:51.697709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:51.702055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:51.757250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1000/1999] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:51 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:51.764273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:51.804009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939d1fc2-999f-4dee-a68d-3c1613a8d8a6 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.064354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:52.067259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.067965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.068815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.070607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:52.077369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:52.157193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1000/2000] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:51 2022] POST /identity/v3/users => generated 292 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:52.159187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:52.182547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a113dfc-2ed4-4303-9c69-7b4bc049edd5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.191585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:52.192829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.193539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.194172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.195543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:52.198712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:52.201656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:52.221938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1001/2001] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:52.228262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:52.247234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef444c-8473-4a0b-98fd-7114f0477a58 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.256578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:52.257719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.259092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.259728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.260666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:52.262818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966c77-4166-4421-aa7b-ce404ef39ad5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:52.284899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1001/2002] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:52.290956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:52.314141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572231e-0851-408a-9e5b-43a925e59237 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.347036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:52.348304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.348775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.349511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] PATH_INFO: `/v3/projects/cc54afdcf248454895c5a17fe6f44a03/users/2905d756e7ea494eb92ad7d77aef7b3d/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.391566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc54afdcf248454895c5a17fe6f44a03, user_id=2905d756e7ea494eb92ad7d77aef7b3d, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:52.396505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:52.420605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1002/2003] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:52 2022] PUT /identity/v3/projects/cc54afdcf248454895c5a17fe6f44a03/users/2905d756e7ea494eb92ad7d77aef7b3d/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:52.439373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.439948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.440555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.499963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] MFA Rules not processed for user `2905d756e7ea494eb92ad7d77aef7b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:52.501490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:52.625575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1002/2004] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:52.632304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:52.800287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae6c43-574d-4cd0-9f24-ede1eb9f3244 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.808955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:52.810221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:52.811025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:52.811699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:52.813197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:52.817164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:52.881616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1003/2005] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:52 2022] POST /identity/v3/projects => generated 383 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:52.884781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:52.922318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9ba88-2a38-4437-938e-e716ea5381ba None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:52.987441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:53.019895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.019895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.019895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.019895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.020454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.023444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.068004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1003/2006] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:52 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:53.073197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.084035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e817cb-ba0b-4d1b-a0e9-6eb1a2dfd59f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.100052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.100052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.100052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.100555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.101760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.103414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.118132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1004/2007] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:53.121822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.134026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05c7ce-9318-490d-8bd9-43c4b610b476 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.139106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.140271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.140271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.140567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.141225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.143369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b7ee-974b-4a25-98e2-46f50c8cc1a8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.160790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1004/2008] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:53.161319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.174249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06df64-ad21-41fb-b247-e03d72fc0a43 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.180780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.181792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.182349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.182788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] PATH_INFO: `/v3/projects/36c3d882ce2e4f638ef1f214b388f6e1/users/486bebfe9d7a4745a4f1ddf122f6f6df/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.203805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c3d882ce2e4f638ef1f214b388f6e1, user_id=486bebfe9d7a4745a4f1ddf122f6f6df, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.206884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.236278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1005/2009] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:53 2022] PUT /identity/v3/projects/36c3d882ce2e4f638ef1f214b388f6e1/users/486bebfe9d7a4745a4f1ddf122f6f6df/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:53.238620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.239125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.239602 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.273020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] MFA Rules not processed for user `486bebfe9d7a4745a4f1ddf122f6f6df`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:53.275089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:53.388358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1005/2010] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:53.390754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.577272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac704a-f8b3-41eb-85b1-88d532743b3b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.587474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.588324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.588764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.589242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.590415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.594521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.639011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1006/2011] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:53 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:53.644548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.664556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d424e-c8ad-4527-b97e-ee8ebd1a1d7c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.786631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.787705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.791205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.791205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.792483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.796592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.832998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1006/2012] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:53 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:53.839388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.863185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec551e-f904-4bb5-b273-e8a537fcd5b6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.873498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.874494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.874985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.875441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.876623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.879851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.883105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:53.898539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1007/2013] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:53.904944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:53.917316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1775855-55e0-440d-8cb5-2d978005000f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:53.923650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:53.924363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:53.924650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:53.925614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] PATH_INFO: `/v3/projects/3b9576c33cf6420a96357b8cce219cb7/users/126ae252524940f9bbba581d33f7ef70/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:53.950432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9576c33cf6420a96357b8cce219cb7, user_id=126ae252524940f9bbba581d33f7ef70, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:53.953991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:53.980051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1007/2014] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:53 2022] PUT /identity/v3/projects/3b9576c33cf6420a96357b8cce219cb7/users/126ae252524940f9bbba581d33f7ef70/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:53.985880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:54.016552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f475e73-c14d-4b62-b12d-fd858343fb5e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:54.141896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:54.152761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:54.153455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:54.154026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:54.155311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:54.161195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea05f5-5313-44e9-bdf8-315c3066ab31 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:54.207044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:54.207287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1008/2015] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:54.220344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a63e2d-34cc-440d-8b37-391bea1a850e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:54.225978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:54.226704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:54.227016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:54.227396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] PATH_INFO: `/v3/projects/3b9576c33cf6420a96357b8cce219cb7/users/126ae252524940f9bbba581d33f7ef70/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:54.229389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9576c33cf6420a96357b8cce219cb7, user_id=126ae252524940f9bbba581d33f7ef70, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:54.232805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:54.241807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:54.247476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1008/2016] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:54 2022] PUT /identity/v3/projects/3b9576c33cf6420a96357b8cce219cb7/users/126ae252524940f9bbba581d33f7ef70/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:54.268966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:54.269504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:54.269984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:54.328972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] MFA Rules not processed for user `126ae252524940f9bbba581d33f7ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:54.330242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:54.422393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1009/2017] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:54.436846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:54.438708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:54.521292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0356c5-c1e4-4a97-ad14-25122c03cfd3 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:54.525171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:54.525831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:54.526266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:54.526541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:54.647224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:54.649250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:54.666976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1009/2018] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:56.508185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:56.509915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:56.522954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba7fc-59b2-472f-8029-f3078757a509 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:56.527018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:56.527654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:56.527934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:56.528205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:56.605644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:56.607195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:56.625731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1010/2019] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:57.689600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:57.704010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4908e-509d-41bc-95e6-0b7744d407ad service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:57.714833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:57.717714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:57.718318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:57.719145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:57.779040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:57.783685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:57.809969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1010/2020] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:21:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:21:58.474718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:58.476295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:58.511524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:58.603698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476035fe-dbb3-4d23-b104-eab99e661420 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:58.608443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:58.609114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:58.609422 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:58.609686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] PATH_INFO: `/v3/users/8fcf84d1b6d04255b62ab22d35e80280` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:58.610847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fcf84d1b6d04255b62ab22d35e80280)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:58.612814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:58.674161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fcf84d1b6d04255b62ab22d35e80280'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:58.687959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fcf84d1b6d04255b62ab22d35e80280'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:58.688674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fcf84d1b6d04255b62ab22d35e80280'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:58.696846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fcf84d1b6d04255b62ab22d35e80280'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:58.697668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e5f7992e-5395-4250-9d99-d23b64748227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fcf84d1b6d04255b62ab22d35e80280'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:58.710583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1011/2021] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:21:58 2022] DELETE /identity/v3/users/8fcf84d1b6d04255b62ab22d35e80280 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:21:58.961846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:58.979000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb83c4-3fc2-442a-b5cc-36ee6ab945cc service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.068410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.069499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.070035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.070522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] PATH_INFO: `/v3/projects/b29ac730884f411b91b8cb922f7b0bea` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.072508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b29ac730884f411b91b8cb922f7b0bea)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.075978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.141810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:59.146197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b29ac730884f411b91b8cb922f7b0bea', 'request_id': 'req-af4a40e8-8188-4150-9d56-8d9a523adfeb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:59.164091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b29ac730884f411b91b8cb922f7b0bea', 'request_id': 'req-af4a40e8-8188-4150-9d56-8d9a523adfeb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:59.178938 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b29ac730884f411b91b8cb922f7b0bea', 'request_id': 'req-af4a40e8-8188-4150-9d56-8d9a523adfeb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:59.196965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] The token cache is being invalidate because project b29ac730884f411b91b8cb922f7b0bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:21:59.197259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:59.197981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-af4a40e8-8188-4150-9d56-8d9a523adfeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:21:59.209600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1011/2022] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:21:58 2022] DELETE /identity/v3/projects/b29ac730884f411b91b8cb922f7b0bea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:59.210936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.211406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.212130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.233933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:59.235164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:59.306786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1012/2023] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:59.320118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.320405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.320687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.342249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:59.343469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:59.352631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1012/2024] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:21:59.356938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.367315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01191450-8a1b-4c18-811f-260333b3ed83 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.372351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.372996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.373275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.373588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.374242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:21:59.374563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.376195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.388806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1013/2025] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:21:59.397438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.408958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628397d-b501-4f95-be07-dbdeb57e2ece None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.414443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.415059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.415824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.415824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.416290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.418267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.463048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1013/2026] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:59.464154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.475604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5bf9-5f8a-4706-9cb4-e6b8b39f415a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.534554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:21:59.606554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.608256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.610484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.611105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.612652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.614915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.659851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1014/2027] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:21:59.665708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.679047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5fa43-0ce0-4994-aa1b-f86fb86fcfe7 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.686906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.687560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.687871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.695308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.703264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.705021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.730328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1014/2028] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:59.735643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.751839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bb17b-39cf-42b0-8522-5082aa3ca799 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.760699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.761733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.761978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.762412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.763126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.770629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd826ecf-e516-47e2-93b2-f0de34e48184 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.788615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1015/2029] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:21:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:21:59.792623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:21:59.805438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afee8ca8-9036-40da-ac84-940da428db4c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:21:59.817442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:21:59.817442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.817442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.817442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] PATH_INFO: `/v3/projects/f225c7bf2e38407383500f0486769f33/users/5c2d1639615e4e4eb22d44c5f50b1b0a/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.835973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f225c7bf2e38407383500f0486769f33, user_id=5c2d1639615e4e4eb22d44c5f50b1b0a, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:21:59.839485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:21:59.857539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1015/2030] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:21:59 2022] PUT /identity/v3/projects/f225c7bf2e38407383500f0486769f33/users/5c2d1639615e4e4eb22d44c5f50b1b0a/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:21:59.868539 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:21:59.869168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:21:59.869612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:21:59.902153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] MFA Rules not processed for user `5c2d1639615e4e4eb22d44c5f50b1b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:21:59.903783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:21:59.976003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1016/2031] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:21:59.980662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.081286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62256b2a-d618-42a2-9e88-bc5ce37462f1 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.086514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.087133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.087410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.087678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.090267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.092498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.138356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1016/2032] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:21:59 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:00.139425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.159890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28245e85-e32f-4eca-9973-139b16f32da1 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.269282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.270384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.270743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.271258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.272225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.276369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.309471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1017/2033] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:00 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:00.310536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.322261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b6c6c-eac1-475a-b5e5-b29984c13658 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.327641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.328558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.328864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.329110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.329814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.331618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.347175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1017/2034] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:00.351971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.362387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20eed4b-cb3f-496e-81eb-4ac230d2bbef admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.368728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.369872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.370335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.370800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] PATH_INFO: `/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5/users/606c5aec47944c99bedb5e47ff74e3d9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.396509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0533ada17b0d499aa4ac3ae604ba83d5, user_id=606c5aec47944c99bedb5e47ff74e3d9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.399420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.402941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:00.425565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1018/2035] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:00 2022] PUT /identity/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5/users/606c5aec47944c99bedb5e47ff74e3d9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:00.431327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.448259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c019d-3983-40ff-8dab-b8f1959a5e1b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.493914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:00.513722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.514340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.514623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.514896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.515545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.517523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a7d8-1799-4448-bf0a-d590acd167db admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.532509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1018/2036] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:00.534498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.552920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bfbbb-81c6-4d55-80b5-790938c40873 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.561099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.562316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.562802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.563300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] PATH_INFO: `/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5/users/606c5aec47944c99bedb5e47ff74e3d9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.566529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0533ada17b0d499aa4ac3ae604ba83d5, user_id=606c5aec47944c99bedb5e47ff74e3d9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.572085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.590785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1019/2037] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:00 2022] PUT /identity/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5/users/606c5aec47944c99bedb5e47ff74e3d9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:00.603634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659c6d-247b-4286-af9d-42017076302a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.604491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659c6d-247b-4286-af9d-42017076302a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.605142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29659c6d-247b-4286-af9d-42017076302a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.650947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-29659c6d-247b-4286-af9d-42017076302a None None] MFA Rules not processed for user `606c5aec47944c99bedb5e47ff74e3d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:00.652407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-29659c6d-247b-4286-af9d-42017076302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:00.734876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1019/2038] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:00.756809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:00.763632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:00.877094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440add61-2a80-49fe-8dcf-e3f2b69366a9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:00.883846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:00.885022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:00.885756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:00.886235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:00.903612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:00.906457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784b8a9-be29-43c0-ab4c-68727058efd2 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:00.941758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1020/2039] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:01.439320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29659c6d-247b-4286-af9d-42017076302a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:01.513759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29659c6d-247b-4286-af9d-42017076302a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:01.518984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:01.519692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:01.519922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:01.520196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] PATH_INFO: `/v3/users/5c2d1639615e4e4eb22d44c5f50b1b0a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:01.521450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2d1639615e4e4eb22d44c5f50b1b0a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:01.523890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:01.584375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2d1639615e4e4eb22d44c5f50b1b0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:01.596604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2d1639615e4e4eb22d44c5f50b1b0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:01.607944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:01.615242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2d1639615e4e4eb22d44c5f50b1b0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:01.617065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2d1639615e4e4eb22d44c5f50b1b0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:01.626482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2d1639615e4e4eb22d44c5f50b1b0a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:01.633479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1020/2040] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:01 2022] DELETE /identity/v3/users/5c2d1639615e4e4eb22d44c5f50b1b0a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:01.638657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:01.639231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:01.639231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:01.661337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:01.662697 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:01.736040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1021/2041] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:01.746419 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:01.748577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:01.808206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc30a2-7ff2-4a93-8754-0e620e9e5990 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:01.812378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:01.812963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:01.813239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:01.813530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:01.829682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:01.831052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:01.841772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1021/2042] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:02.143586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:02.143586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:02.174427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149d6c2-6295-4e14-ae64-f5b1fe5d119b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:02.179968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:02.181139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:02.181885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:02.182193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] PATH_INFO: `/v3/projects/f225c7bf2e38407383500f0486769f33` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:02.183921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f225c7bf2e38407383500f0486769f33)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:02.186736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:02.229657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:02.232423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:02.258558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc4d00-f8f1-40f5-8d14-76c1f3c920fd service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:02.262832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f225c7bf2e38407383500f0486769f33', 'request_id': 'req-7a858a1b-8abe-482a-a6d6-3fb6e2214010'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.271134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f225c7bf2e38407383500f0486769f33', 'request_id': 'req-7a858a1b-8abe-482a-a6d6-3fb6e2214010'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.279813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f225c7bf2e38407383500f0486769f33', 'request_id': 'req-7a858a1b-8abe-482a-a6d6-3fb6e2214010'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.349649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] The token cache is being invalidate because project f225c7bf2e38407383500f0486769f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:02.350312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.352979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.361830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1022/2043] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:02 2022] DELETE /identity/v3/projects/f225c7bf2e38407383500f0486769f33 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:02.366419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:02.373895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:02.384654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:02.386165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:02.386574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:02.387086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] PATH_INFO: `/v3/users/2905d756e7ea494eb92ad7d77aef7b3d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:02.388956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2905d756e7ea494eb92ad7d77aef7b3d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:02.392874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:02.398939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858a1b-8abe-482a-a6d6-3fb6e2214010 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:02.407952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:02.409095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:02.409686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:02.410680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] PATH_INFO: `/v3/users/606c5aec47944c99bedb5e47ff74e3d9` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:02.412553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606c5aec47944c99bedb5e47ff74e3d9)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:02.416397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:02.421678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:02.503393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2905d756e7ea494eb92ad7d77aef7b3d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.516374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2905d756e7ea494eb92ad7d77aef7b3d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.519367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606c5aec47944c99bedb5e47ff74e3d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.534616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2905d756e7ea494eb92ad7d77aef7b3d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.535690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2905d756e7ea494eb92ad7d77aef7b3d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.542089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606c5aec47944c99bedb5e47ff74e3d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.543561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606c5aec47944c99bedb5e47ff74e3d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.545639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-92626728-32dc-41dc-b200-65e4c05507be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2905d756e7ea494eb92ad7d77aef7b3d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.556020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1022/2044] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:02 2022] DELETE /identity/v3/users/2905d756e7ea494eb92ad7d77aef7b3d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:02.562085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:02.562561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:02.562984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:02.569272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606c5aec47944c99bedb5e47ff74e3d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.570496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606c5aec47944c99bedb5e47ff74e3d9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:02.574144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:02.587601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:02.589621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:02.598199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1023/2045] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:02 2022] DELETE /identity/v3/users/606c5aec47944c99bedb5e47ff74e3d9 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:02.671534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1023/2046] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:02.684913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:02.686563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:02.758031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b4ab-7390-4cdb-9736-b0be68cc79b9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:02.763854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:02.764597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:02.764946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:02.765289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:02.862246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:02.863889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289955f-ddee-4356-95bf-b805fb4c1f98 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:02.884377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1024/2047] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:03.078048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.080337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.103188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5eac4e-f364-4680-8eb3-89c494210fc9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.114671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.115722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.116282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.116853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] PATH_INFO: `/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.119212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0533ada17b0d499aa4ac3ae604ba83d5)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.123314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.224795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0533ada17b0d499aa4ac3ae604ba83d5', 'request_id': 'req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.234975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0533ada17b0d499aa4ac3ae604ba83d5', 'request_id': 'req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.245931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0533ada17b0d499aa4ac3ae604ba83d5', 'request_id': 'req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.261473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] The token cache is being invalidate because project 0533ada17b0d499aa4ac3ae604ba83d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:03.261776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.262473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.264406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1024/2048] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:03 2022] DELETE /identity/v3/projects/0533ada17b0d499aa4ac3ae604ba83d5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:03.273968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd20fb-30e5-4541-ba95-c5d22b68ffc1 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.274456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd20fb-30e5-4541-ba95-c5d22b68ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.274931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd20fb-30e5-4541-ba95-c5d22b68ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.300993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-77dd20fb-30e5-4541-ba95-c5d22b68ffc1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:03.302468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-77dd20fb-30e5-4541-ba95-c5d22b68ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.323184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.325891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.363350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:03.417456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1025/2049] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:03.423867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.424162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.424425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.438293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e667-eb1a-4cdc-8f31-b88cf1f719b3 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.444369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.445260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.445615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:03.445871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.446294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] PATH_INFO: `/v3/projects/cc54afdcf248454895c5a17fe6f44a03` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.447460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc54afdcf248454895c5a17fe6f44a03)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.448373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.450094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.461343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1026/2050] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:03.462734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.472870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c56a97-466c-40cc-83f5-4647b677d291 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.479288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.479976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.480344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.480645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.481297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:03.481706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.483372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.490014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:03.497105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1027/2051] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:03.501812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.508333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc54afdcf248454895c5a17fe6f44a03', 'request_id': 'req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.512388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd6ca8-f1b5-44d1-94c2-e16458c52d01 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.517940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc54afdcf248454895c5a17fe6f44a03', 'request_id': 'req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.525502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc54afdcf248454895c5a17fe6f44a03', 'request_id': 'req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.538251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] The token cache is being invalidate because project cc54afdcf248454895c5a17fe6f44a03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:03.538542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.539200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.541223 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1025/2052] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:03 2022] DELETE /identity/v3/projects/cc54afdcf248454895c5a17fe6f44a03 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:03.545649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.547255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.601382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.601736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.602017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.602293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.603008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.605014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.624558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c5648-68db-4b0b-a8fa-f25f7ecfd952 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.630904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.631921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.632210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.632555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] PATH_INFO: `/v3/users/486bebfe9d7a4745a4f1ddf122f6f6df` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.634799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=486bebfe9d7a4745a4f1ddf122f6f6df)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.636734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.642640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1028/2053] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:03 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:03.648507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.650321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.710120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '486bebfe9d7a4745a4f1ddf122f6f6df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.720045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '486bebfe9d7a4745a4f1ddf122f6f6df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.735735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '486bebfe9d7a4745a4f1ddf122f6f6df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.736638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '486bebfe9d7a4745a4f1ddf122f6f6df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.745494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '486bebfe9d7a4745a4f1ddf122f6f6df'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:03.753198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1026/2054] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:03 2022] DELETE /identity/v3/users/486bebfe9d7a4745a4f1ddf122f6f6df => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:03.772174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eb18d-17dd-4ba2-a0b0-c1ceb67471a5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.852975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:03.875530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.876365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.876889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.877377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.878217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.880834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.911990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1029/2055] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:03 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:03.913585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.915213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:03.931080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d854c6-5980-47c6-a220-ddace7adc1ca admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.936232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.936853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.937129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.937424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.938406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.940015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:03.954096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1027/2056] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:03.958979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:03.981088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d89b0-fbb6-4fad-b6b8-cb070df5e38e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:03.998360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:03.998360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:03.998360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:03.998360 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:03.998999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:03.999598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534ed42-6bea-4f81-88bc-cc57095e6966 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.026259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1030/2057] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:04.031863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.048852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddb20-746e-4ab5-a045-720e1125c08f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.056583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.058273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.058657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.059056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] PATH_INFO: `/v3/projects/25a90932b7834d9bac753bc51222d723/users/bd68c3ff26154695ac12e9344f9ca407/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.080455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a90932b7834d9bac753bc51222d723, user_id=bd68c3ff26154695ac12e9344f9ca407, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.083268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.098014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1028/2058] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:04 2022] PUT /identity/v3/projects/25a90932b7834d9bac753bc51222d723/users/bd68c3ff26154695ac12e9344f9ca407/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:04.108878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.109152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.109480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.139613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] MFA Rules not processed for user `bd68c3ff26154695ac12e9344f9ca407`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:04.140770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:04.211997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1031/2059] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:04.216845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.221588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:04.286122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741b783-ac84-40a3-86e3-f76386059824 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.291210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.291989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.292099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.292381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.293177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.295632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.338229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1029/2060] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:04 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:04.342464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.351669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.353828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:04.360929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706ebb1-55f8-496c-b49c-f0207f2e82a2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.437896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03a3a3e-170a-4953-b745-33678bba2b1e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.443633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.444323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.444690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.444988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] PATH_INFO: `/v3/projects/36c3d882ce2e4f638ef1f214b388f6e1` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.446418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c3d882ce2e4f638ef1f214b388f6e1)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.448441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.448925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.449202 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.449573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.449906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.451352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.453961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.485939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1032/2061] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:04 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:04.490469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.504211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a863d0d-e789-42f9-80d2-5c744e00c3a7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.513315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c3d882ce2e4f638ef1f214b388f6e1', 'request_id': 'req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.524973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c3d882ce2e4f638ef1f214b388f6e1', 'request_id': 'req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.538649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c3d882ce2e4f638ef1f214b388f6e1', 'request_id': 'req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.558858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] The token cache is being invalidate because project 36c3d882ce2e4f638ef1f214b388f6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:04.559738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.561527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.564027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1030/2062] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:04 2022] DELETE /identity/v3/projects/36c3d882ce2e4f638ef1f214b388f6e1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:04.571042 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.573285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:04.574321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:04.603928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.604997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.605583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.606567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.607554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.611176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:04.611675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.630084 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1033/2063] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:04.635847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.638377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:04.657738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe661e6-3df5-4e14-b1fd-070071ba2264 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.664546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.665786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.666077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.666353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] PATH_INFO: `/v3/projects/33170f013cc441da80f4512dbf153476/users/7184faa263d0430f8e45eb4c9c158dfa/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.685969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33170f013cc441da80f4512dbf153476, user_id=7184faa263d0430f8e45eb4c9c158dfa, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.688582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.688699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c2fbb-6bd7-47e5-905b-436a97ee7732 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.696968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.697626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.697907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.698256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] PATH_INFO: `/v3/users/126ae252524940f9bbba581d33f7ef70` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.699934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=126ae252524940f9bbba581d33f7ef70)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.702071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.718482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1034/2064] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:04 2022] PUT /identity/v3/projects/33170f013cc441da80f4512dbf153476/users/7184faa263d0430f8e45eb4c9c158dfa/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:04.723887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.770334 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126ae252524940f9bbba581d33f7ef70'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.784342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126ae252524940f9bbba581d33f7ef70'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.801425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126ae252524940f9bbba581d33f7ef70'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.802558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126ae252524940f9bbba581d33f7ef70'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.807506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3ceb-26b3-427e-b1e4-3c7086deb3c4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.812247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126ae252524940f9bbba581d33f7ef70'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:04.816430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.817576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.818148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.818719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.822363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1031/2065] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:04 2022] DELETE /identity/v3/users/126ae252524940f9bbba581d33f7ef70 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:04.822533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.823607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb6c6d-769f-4c36-9ace-4da01f5ffc9e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.846530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1035/2066] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:04.851050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:04.852583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:04.948908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23440f2-4c2a-4275-ac64-84768b405d8d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:04.956120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:04.956997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:04.957352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:04.957860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] PATH_INFO: `/v3/projects/33170f013cc441da80f4512dbf153476/users/7184faa263d0430f8e45eb4c9c158dfa/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:04.961151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=33170f013cc441da80f4512dbf153476, user_id=7184faa263d0430f8e45eb4c9c158dfa, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:04.965297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:04.989183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1032/2067] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:04 2022] PUT /identity/v3/projects/33170f013cc441da80f4512dbf153476/users/7184faa263d0430f8e45eb4c9c158dfa/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:05.003171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.003676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.004130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.043392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] MFA Rules not processed for user `7184faa263d0430f8e45eb4c9c158dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:05.045119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.165530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1036/2068] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:05.182999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.185022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.231850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:05.275070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.276880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.280021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27da70-d682-4832-a163-bbaf195280ff admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.286216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.287280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.287763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.288348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.308605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.311390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.332085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1033/2069] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:05.339018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:05.371600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580a49-38a4-46d1-8243-5739e85eca5a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.378212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.379003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.379286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.379741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] PATH_INFO: `/v3/projects/3b9576c33cf6420a96357b8cce219cb7` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.380894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9576c33cf6420a96357b8cce219cb7)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.382997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.459882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9576c33cf6420a96357b8cce219cb7', 'request_id': 'req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:05.466643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9576c33cf6420a96357b8cce219cb7', 'request_id': 'req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:05.485993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9576c33cf6420a96357b8cce219cb7', 'request_id': 'req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:05.501156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] The token cache is being invalidate because project 3b9576c33cf6420a96357b8cce219cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:05.501370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:05.501988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-cdfe1b1b-4000-4f1d-94c9-4a911fb1b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:05.503087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.505490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1037/2070] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:05 2022] DELETE /identity/v3/projects/3b9576c33cf6420a96357b8cce219cb7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:05.505634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.508610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e8a3-0703-4756-bd37-a66eca893b67 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.509101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e8a3-0703-4756-bd37-a66eca893b67 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.509383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972e8a3-0703-4756-bd37-a66eca893b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.532553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3972e8a3-0703-4756-bd37-a66eca893b67 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:05.535282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3972e8a3-0703-4756-bd37-a66eca893b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.536616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e381f-6fb7-434e-a09b-ba39f80919a0 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.634902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1038/2071] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:05.644091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.644622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.644983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.647661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.648722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.649222 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.649750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.652720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.669044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:05.670685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:05.684247 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1039/2072] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:05.686298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.702802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4320ca-00af-47cd-b0bd-be52ca1152aa None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.711436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.712149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.712522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.712877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.713944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:05.714341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.716889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.740217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1040/2073] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:05.741631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.751632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.753464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.759960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd87a-4b33-4ad8-999b-d7ec5ddb1611 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.766514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1034/2074] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:05.768614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.769558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.770090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.770581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.771373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.774297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.817500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1041/2075] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:05 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:05.823065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.836012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf0e5-dea8-4246-884c-39d828d7d6c1 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:05.930824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:05.931809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:05.932304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:05.932752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:05.933894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:05.937561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:05.974806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1035/2076] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:05 2022] POST /identity/v3/users => generated 285 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:05.976906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:05.995372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b66a7-be0f-442c-a0a6-be70c5cd47e0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:06.002570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:06.003477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:06.004063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:06.004633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:06.005974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:06.007201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:06.020949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1042/2077] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:06.026465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:06.038615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6b413-e58d-4b20-abf5-823ea9cd741b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:06.044202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:06.044875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:06.045159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:06.045458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:06.046134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:06.047830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605339b8-8830-4dd1-8b06-cec477d717a4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:06.060281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1036/2078] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:06.065312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:06.084297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216707e-9d3d-4c91-8b9e-bdf0fa02ab4a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:06.094008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:06.095151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:06.095753 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:06.096085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] PATH_INFO: `/v3/projects/8f1b35218c96457ba17be2631e29cfe8/users/1ba1e9c169524ac0972880ad05bb4153/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:06.116682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:06.124768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1b35218c96457ba17be2631e29cfe8, user_id=1ba1e9c169524ac0972880ad05bb4153, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:06.131726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:06.157730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1043/2079] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:06 2022] PUT /identity/v3/projects/8f1b35218c96457ba17be2631e29cfe8/users/1ba1e9c169524ac0972880ad05bb4153/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:06.173020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:06.173316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:06.173628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:06.182093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:06.218289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] MFA Rules not processed for user `1ba1e9c169524ac0972880ad05bb4153`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:06.219646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:06.343676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1037/2080] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:06.352760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:06.354612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:06.490599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057e53d-d076-4834-9429-ba2816e6f971 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:06.495531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:06.496324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:06.496772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:06.497275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:06.507276 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:06.508775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725bcbbc-000f-4d8c-8619-dcccdb955f42 service glance] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:06.519446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1044/2081] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:07.504641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:07.506700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:07.591373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839e999-49cd-4911-a168-3d54c89089ae None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:07.596058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:07.596718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:07.597004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:07.597281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] PATH_INFO: `/v3/users/bd68c3ff26154695ac12e9344f9ca407` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:07.599077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd68c3ff26154695ac12e9344f9ca407)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:07.601030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:07.667206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd68c3ff26154695ac12e9344f9ca407'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:07.676616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd68c3ff26154695ac12e9344f9ca407'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:07.691717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd68c3ff26154695ac12e9344f9ca407'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:07.692456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd68c3ff26154695ac12e9344f9ca407'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:07.700228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd68c3ff26154695ac12e9344f9ca407'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:07.708903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1038/2082] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:07 2022] DELETE /identity/v3/users/bd68c3ff26154695ac12e9344f9ca407 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:07.713444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:07.714098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:07.714098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:07.734854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:07.736473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:07.829621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1045/2083] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:07.842298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:07.845500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:07.866413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:07.975344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ed85f-7a72-41fb-a995-b7a126e071a5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:07.984456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:07.985545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:07.986029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:07.986510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:08.003155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:08.006193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:08.026515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1039/2084] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:08.408300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:08.411455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:08.443446 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf88f2d-9a3d-47e7-aa3a-24f73d22efec None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:08.450189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:08.451919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:08.452604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:08.454082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] PATH_INFO: `/v3/projects/25a90932b7834d9bac753bc51222d723` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:08.456664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a90932b7834d9bac753bc51222d723)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:08.459481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:08.516565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a90932b7834d9bac753bc51222d723', 'request_id': 'req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.523744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a90932b7834d9bac753bc51222d723', 'request_id': 'req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.534118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a90932b7834d9bac753bc51222d723', 'request_id': 'req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.538458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:08.551871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] The token cache is being invalidate because project 25a90932b7834d9bac753bc51222d723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:08.552781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.553846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.555749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1046/2085] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:08 2022] DELETE /identity/v3/projects/25a90932b7834d9bac753bc51222d723 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:08.559959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:08.571084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef5ef3-e37d-4813-b274-63d29c3bbc14 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:08.636678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:08.637324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:08.637690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:08.637967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] PATH_INFO: `/v3/users/7184faa263d0430f8e45eb4c9c158dfa` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:08.639112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7184faa263d0430f8e45eb4c9c158dfa)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:08.641064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:08.692885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7184faa263d0430f8e45eb4c9c158dfa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.702412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7184faa263d0430f8e45eb4c9c158dfa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.715280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7184faa263d0430f8e45eb4c9c158dfa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.716048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7184faa263d0430f8e45eb4c9c158dfa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.723396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1bf18ed6-69b3-48f8-a151-b78f95b95025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7184faa263d0430f8e45eb4c9c158dfa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:08.729618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1040/2086] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:08 2022] DELETE /identity/v3/users/7184faa263d0430f8e45eb4c9c158dfa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:09.117670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.119783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:09.144419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e85fcd-c1cf-451b-86c3-5a70c10aad69 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.267438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.268768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.269373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.269997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] PATH_INFO: `/v3/projects/33170f013cc441da80f4512dbf153476` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.274056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33170f013cc441da80f4512dbf153476)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.276296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.337243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33170f013cc441da80f4512dbf153476', 'request_id': 'req-7868af50-6f86-4bfa-a07a-17e110260e92'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:09.343413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33170f013cc441da80f4512dbf153476', 'request_id': 'req-7868af50-6f86-4bfa-a07a-17e110260e92'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:09.351532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33170f013cc441da80f4512dbf153476', 'request_id': 'req-7868af50-6f86-4bfa-a07a-17e110260e92'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:09.371225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] The token cache is being invalidate because project 33170f013cc441da80f4512dbf153476 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:09.371480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:09.372173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7868af50-6f86-4bfa-a07a-17e110260e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:09.373838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1047/2087] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:09 2022] DELETE /identity/v3/projects/33170f013cc441da80f4512dbf153476 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:09.378863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.379159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.379457 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.409036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:09.411584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:09.461296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:09.521621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1041/2088] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:09.529365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.529699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.529944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.551845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:09.553110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:09.561654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1048/2089] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:09.566703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.579219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15d5cc-db2e-496e-b05e-ae679d6e2e15 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.588333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.588968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.589297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.589559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.590229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:09.590530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.592435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.608237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1042/2090] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:09.612845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.630663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21d716-3bba-4511-acf9-0a5b095a9597 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.638914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.639981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.640478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.640957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.642523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.646771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.694926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1049/2091] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:09 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:09.699568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.710921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d007-5aef-4a67-9538-9c53c6f90a8e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.780047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.781045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.781534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.781998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.783129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.786900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.816740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1043/2092] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:09 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:09.822832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.835421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3f0f-f625-43b3-85e9-c9dad4c68fc8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.840511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.841210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.841535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.841859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.842572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.844197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.859794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1050/2093] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:09.861111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.872380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae2c8a-a994-4efc-a15a-910736c706f5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.877982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.878597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.878874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.879138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.879789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.881925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2365f7-f5b7-4462-9455-8fa91f51a5c0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.894405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1044/2094] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:09.899339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:09.910483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9407d4a-3eca-4498-a8e6-4b1388177375 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:09.916478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:09.917161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.917465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.917740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] PATH_INFO: `/v3/projects/83812f35b1e84f218174b13ec146bbd6/users/e0be14049bf44424b9abc328b765c08c/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:09.937409 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=83812f35b1e84f218174b13ec146bbd6, user_id=e0be14049bf44424b9abc328b765c08c, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:09.940114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:09.955425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1051/2095] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:09 2022] PUT /identity/v3/projects/83812f35b1e84f218174b13ec146bbd6/users/e0be14049bf44424b9abc328b765c08c/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:09.966933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:09.967266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:09.967594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.004166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] MFA Rules not processed for user `e0be14049bf44424b9abc328b765c08c`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:10.005425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:10.088193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1045/2096] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:10.093317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.120510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:10.164261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617309-af7b-4c0b-9eea-a62fa7708a1c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.169579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.170177 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.170480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.170751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.171438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.173368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.206875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1052/2097] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:10 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:10.209161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.222131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcb77d-80a8-4b0d-b10d-cdf78ca1909b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.251627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:10.291827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.292508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.292934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.293285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.294355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.296784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.326044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1046/2098] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:10 2022] POST /identity/v3/users => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:10.330362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.342821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27485482-bba8-40a4-8213-594ae880be13 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.349200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.350152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.350526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.350899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.351658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.353300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.369528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1053/2099] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:10.370771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.383362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29321e24-7f8b-4045-9089-d7242b08f1aa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.388725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.389433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.389729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.390001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] PATH_INFO: `/v3/projects/227e28b64476490f90ec7dc8774de49d/users/be1ff6170e4e4869be6a7c71733f413c/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.407850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=227e28b64476490f90ec7dc8774de49d, user_id=be1ff6170e4e4869be6a7c71733f413c, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.410608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.428692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1047/2100] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:10 2022] PUT /identity/v3/projects/227e28b64476490f90ec7dc8774de49d/users/be1ff6170e4e4869be6a7c71733f413c/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:10.433900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.449111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf35afc-e814-468f-a1f2-975892908f13 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.529765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.529765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.529765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.529765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.530141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.531928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9da51-8ba9-4520-bf18-1b27bab16011 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.544564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1054/2101] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:10.550491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.565493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195cc90-ed5a-47a0-b717-5f890bfc3a6c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.572531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.573752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.574299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.574724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] PATH_INFO: `/v3/projects/227e28b64476490f90ec7dc8774de49d/users/be1ff6170e4e4869be6a7c71733f413c/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.578483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227e28b64476490f90ec7dc8774de49d, user_id=be1ff6170e4e4869be6a7c71733f413c, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.583627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.603361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1048/2102] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:10 2022] PUT /identity/v3/projects/227e28b64476490f90ec7dc8774de49d/users/be1ff6170e4e4869be6a7c71733f413c/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:10.619083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.619505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.619866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.651860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] MFA Rules not processed for user `be1ff6170e4e4869be6a7c71733f413c`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:10.653118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:10.760804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1055/2103] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:10.770575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:10.772529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:10.843557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87af3-4c6c-491e-a86c-8a7d205fe219 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:10.848278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:10.848982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:10.849320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:10.849794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:10.863285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:10.865753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:10.883784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1049/2104] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:11.020540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:11.038666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ca359-b4c6-41ad-b7af-f48be84732c2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:11.044896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:11.045963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:11.046431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:11.046879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:11.069329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:11.144332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:11.145811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bba2e-39e2-4344-abf9-d41b3d9fe627 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:11.155890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1056/2105] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:13.910133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:13.998526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463f4cc-4278-4294-afe1-e33d5069a084 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:14.004016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:14.004793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:14.005159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:14.005956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] PATH_INFO: `/v3/users/e0be14049bf44424b9abc328b765c08c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:14.007398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0be14049bf44424b9abc328b765c08c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:14.010373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:14.051699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:14.075853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0be14049bf44424b9abc328b765c08c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:14.092882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0be14049bf44424b9abc328b765c08c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:14.109388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0be14049bf44424b9abc328b765c08c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:14.110389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0be14049bf44424b9abc328b765c08c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:14.122996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-22508264-736c-4a93-b1ab-4e46b7a24d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0be14049bf44424b9abc328b765c08c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:14.135336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1050/2106] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:13 2022] DELETE /identity/v3/users/e0be14049bf44424b9abc328b765c08c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:14.143668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:14.144461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:14.144693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:14.178048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:14.180298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:14.334910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:14.334910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:14.334910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:14.342597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1057/2107] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:14.363329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:14.367615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:14.414580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:14.416844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:14.514153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936cf49-0f0e-484d-bb75-163e73801efc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:14.520382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:14.521611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:14.522068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:14.522562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:14.540213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:14.541237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1051/2108] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:22:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:14.544881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:14.560537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1058/2109] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:14.620358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:14.622608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:14.752263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a58c65-14b0-4891-a459-380540cd18ed None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:14.761022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:14.762260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:14.764391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:14.765003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:14.792572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:14.796519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:14.833643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1052/2110] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:22:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 02:22:14.978889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:14.980741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:14.999852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0eee3d-f068-4396-8e5d-b183d8d33d77 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:15.009981 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:15.010807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.011147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.011485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] PATH_INFO: `/v3/projects/83812f35b1e84f218174b13ec146bbd6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:15.012781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83812f35b1e84f218174b13ec146bbd6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:15.015726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:15.081642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83812f35b1e84f218174b13ec146bbd6', 'request_id': 'req-32f45a81-5bdd-40eb-9eae-b2ab24d63799'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.085648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:15.088365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83812f35b1e84f218174b13ec146bbd6', 'request_id': 'req-32f45a81-5bdd-40eb-9eae-b2ab24d63799'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.095948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83812f35b1e84f218174b13ec146bbd6', 'request_id': 'req-32f45a81-5bdd-40eb-9eae-b2ab24d63799'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.109737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] The token cache is being invalidate because project 83812f35b1e84f218174b13ec146bbd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:15.110373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.111203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-32f45a81-5bdd-40eb-9eae-b2ab24d63799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.113766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1059/2111] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:14 2022] DELETE /identity/v3/projects/83812f35b1e84f218174b13ec146bbd6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:15.118325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:15.130865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf71e5c-4aa9-4197-ac9b-8fd4cc4b34bd service swift] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:15.169310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:15.211070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:15.211817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.212097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.212365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] PATH_INFO: `/v3/users/be1ff6170e4e4869be6a7c71733f413c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:15.213550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1ff6170e4e4869be6a7c71733f413c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:15.215960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:15.277562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1ff6170e4e4869be6a7c71733f413c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.293850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1ff6170e4e4869be6a7c71733f413c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.303062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1ff6170e4e4869be6a7c71733f413c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.303782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1ff6170e4e4869be6a7c71733f413c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.322985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1ff6170e4e4869be6a7c71733f413c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.336138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1053/2112] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:15 2022] DELETE /identity/v3/users/be1ff6170e4e4869be6a7c71733f413c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:15.592906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.593461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.594343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:15.615618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:15.616968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:15.687439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1060/2113] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:22:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:15.709853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:15.711720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:15.742339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:15.750512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:15.818272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f012c-3795-43d9-9f75-fa9345ac85bd admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:15.823415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:15.824083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.824372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.824633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:15.835744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:15.837355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b710cb-e47c-4a5e-8abb-8b18ec453ce0 service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:15.846175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1054/2114] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:22:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:22:15.847536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2513d4-6ea5-401a-ae12-3f9cafbb5e80 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:15.853298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:15.854125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.854427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.854592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] PATH_INFO: `/v3/projects/227e28b64476490f90ec7dc8774de49d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:15.857479 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] RBAC: Authorizing `identity:delete_project(project_id=227e28b64476490f90ec7dc8774de49d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:15.860234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:15.920384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227e28b64476490f90ec7dc8774de49d', 'request_id': 'req-5f27f2cd-c986-4720-a858-599f8f20419c'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.929893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227e28b64476490f90ec7dc8774de49d', 'request_id': 'req-5f27f2cd-c986-4720-a858-599f8f20419c'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.940806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227e28b64476490f90ec7dc8774de49d', 'request_id': 'req-5f27f2cd-c986-4720-a858-599f8f20419c'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.966246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] The token cache is being invalidate because project 227e28b64476490f90ec7dc8774de49d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:15.966529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.967207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-5f27f2cd-c986-4720-a858-599f8f20419c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:15.968725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1061/2115] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:15 2022] DELETE /identity/v3/projects/227e28b64476490f90ec7dc8774de49d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:15.974791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:15.975248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:15.976169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.001147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:16.002464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:16.056484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:16.093597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1055/2116] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:16.098214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5cec-c2d4-4da2-8454-e756bf9f4bfa None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.098471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5cec-c2d4-4da2-8454-e756bf9f4bfa None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.099042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af5cec-c2d4-4da2-8454-e756bf9f4bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.119575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-10af5cec-c2d4-4da2-8454-e756bf9f4bfa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:16.120787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-10af5cec-c2d4-4da2-8454-e756bf9f4bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:16.132336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1062/2117] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:16.134580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.152188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4895453-5300-4be1-b8d9-d9337508d384 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.158774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.159746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.161065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.161065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.162266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:16.162877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.165261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.168979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.169340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.169716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.183952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1056/2118] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:16.188566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.193339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:16.195462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:16.201886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffef5de-6164-413f-ae85-4cd47a4a81b2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.205720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:16.212628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.212628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.212628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.212628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.213411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.213411 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.250026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1057/2119] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:16.254502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.295412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1063/2120] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:16.321312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.326533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:16.336784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb588b3-cbbb-4aea-ab13-16281f29e02b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.342912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.343685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.344027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.344323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.345052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.347088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.372580 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1058/2121] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:16.378475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.390418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6663-4efe-4c7b-a76f-b7b6e92524be admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.396145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.396859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.397055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.397474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.398010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.399866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.411234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1059/2122] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:16.417363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.429579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b719ac-db42-4e29-8523-89c7382478df admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.434837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.435462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.435744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.436018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.436673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.438467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.457634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1060/2123] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:16.457634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.465201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d19be-0374-4c75-8980-3a5e32965159 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.472169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2754d-f194-47e9-be81-85badb472445 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.477668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.478535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.478821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.479103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] PATH_INFO: `/v3/projects/096200ccc080414f917f8c5983440ee3/users/6c3aafeec38841ef9027def144fb76e6/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.499517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=096200ccc080414f917f8c5983440ee3, user_id=6c3aafeec38841ef9027def144fb76e6, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.502721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a2d3d-5b87-4158-bf6f-f000a739a5ec admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.518311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1061/2124] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:16 2022] PUT /identity/v3/projects/096200ccc080414f917f8c5983440ee3/users/6c3aafeec38841ef9027def144fb76e6/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:16.531215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.531634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.532098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.564164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.564665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] MFA Rules not processed for user `6c3aafeec38841ef9027def144fb76e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:16.564938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.565183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.565488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.566245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:16.624917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:16.630900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.634312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.643432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:16.658893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1062/2125] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:16.662941 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1064/2126] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:22:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:22:16.664019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.743218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a154747-db72-4c35-9a17-fdcaa3f80406 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.750261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.750899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.751181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.751458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.752112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.754586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:16.816702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1063/2127] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:16.821306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:16.848417 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a722417-f8fb-481b-bf05-7462aa175c7d service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:16.965747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:16.967153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:16.967153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:16.967153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:16.967789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:16.970097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.002366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1065/2128] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:16 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:17.004370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.019786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80f402-9290-4816-ba67-b0a62ee5a2b1 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.030434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.031764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.031764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.031999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.034084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.039002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89c74d-42ec-4a6a-af7e-4a29a4a98239 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.069328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1064/2129] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:17.073340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.097309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d86dd-e962-46c1-80e6-2b15984ac961 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.103218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.104175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.104683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.105097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] PATH_INFO: `/v3/projects/83ad6c09f1dc4cc792c05d1923f16096/users/0b79eb1a4570478886c7526041704fc6/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.118282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.118746 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.119114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.127798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ad6c09f1dc4cc792c05d1923f16096, user_id=0b79eb1a4570478886c7526041704fc6, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.131033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.140627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:17.142893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:17.150058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1066/2130] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:17 2022] PUT /identity/v3/projects/83ad6c09f1dc4cc792c05d1923f16096/users/0b79eb1a4570478886c7526041704fc6/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:17.154403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.213549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1065/2131] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:17.227731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.230111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b4576f-7d3b-44a6-9c43-a17381dd5558 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.236089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.236878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.237235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.237644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.238601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.240739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.252937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1067/2132] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:17.257220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.272675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73059cf4-8eb5-4a46-8aa6-d868e91e9766 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.278676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.279518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.279811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.280086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] PATH_INFO: `/v3/projects/83ad6c09f1dc4cc792c05d1923f16096/users/0b79eb1a4570478886c7526041704fc6/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.282158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ad6c09f1dc4cc792c05d1923f16096, user_id=0b79eb1a4570478886c7526041704fc6, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.284876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209b225-d5b5-45d8-a4b5-6c86fa5bfb26 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.296552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1068/2133] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:17 2022] PUT /identity/v3/projects/83ad6c09f1dc4cc792c05d1923f16096/users/0b79eb1a4570478886c7526041704fc6/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:17.306185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1191a6-0f48-4035-ae73-ed9db23bd086 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.316427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.316802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.317325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.317533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:17.354424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] MFA Rules not processed for user `0b79eb1a4570478886c7526041704fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:17.355699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:17.399505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.400382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.400720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.401052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.413807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:17.472931 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1069/2134] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:17.490994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:17.498249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:17.498796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.498796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.515587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1066/2135] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:22:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 02:22:17.607560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2383f92-a4ce-4f2c-b1fb-1a8bbd7ec6ed None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:17.613602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:17.614611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:17.615089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:17.615578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:17.635035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:17.637311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30175bf-167d-4f3f-9167-2e37760d97ec service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:17.654390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1070/2136] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:17.924116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:18.038386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f5761-cd14-4657-a72e-fe64e5d07a2d service swift] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:18.050323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:18.051481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:18.052016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:18.052424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] PATH_INFO: `/v3/users/6c3aafeec38841ef9027def144fb76e6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:18.054609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3aafeec38841ef9027def144fb76e6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:18.065906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:18.151280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3aafeec38841ef9027def144fb76e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.154402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:18.164344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3aafeec38841ef9027def144fb76e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.181861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3aafeec38841ef9027def144fb76e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.182723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3aafeec38841ef9027def144fb76e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.191606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3aafeec38841ef9027def144fb76e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.204779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1067/2137] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:17 2022] DELETE /identity/v3/users/6c3aafeec38841ef9027def144fb76e6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:18.206291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306018-2606-4686-b839-516740940696 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:18.206777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306018-2606-4686-b839-516740940696 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:18.207195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306018-2606-4686-b839-516740940696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:18.244243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9c306018-2606-4686-b839-516740940696 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:18.246735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9c306018-2606-4686-b839-516740940696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:18.345847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1071/2138] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:18.356552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:18.358046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:18.446185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a877f4-05a3-4128-9c17-4d65538ccf0d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:18.449817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:18.450436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:18.450716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:18.450987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:18.461836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:18.463306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:18.474316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1068/2139] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:18.803551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306018-2606-4686-b839-516740940696 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:18.805063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9c306018-2606-4686-b839-516740940696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:18.818742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306018-2606-4686-b839-516740940696 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:18.832673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:18.833472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:18.833997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:18.834338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] PATH_INFO: `/v3/projects/096200ccc080414f917f8c5983440ee3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:18.836949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] RBAC: Authorizing `identity:delete_project(project_id=096200ccc080414f917f8c5983440ee3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:18.839339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:18.899273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096200ccc080414f917f8c5983440ee3', 'request_id': 'req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.906509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096200ccc080414f917f8c5983440ee3', 'request_id': 'req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.917480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096200ccc080414f917f8c5983440ee3', 'request_id': 'req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.932577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:18.937949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] The token cache is being invalidate because project 096200ccc080414f917f8c5983440ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:18.938263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.939622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:18.943925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1072/2140] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:18 2022] DELETE /identity/v3/projects/096200ccc080414f917f8c5983440ee3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:18.948107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:18.958710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ef9af-7292-4a53-b4b8-3204c93d6321 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:19.066662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:19.067489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.067997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.068336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] PATH_INFO: `/v3/users/0b79eb1a4570478886c7526041704fc6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.069849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b79eb1a4570478886c7526041704fc6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:19.071827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:19.137280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b79eb1a4570478886c7526041704fc6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.148386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b79eb1a4570478886c7526041704fc6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.166822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b79eb1a4570478886c7526041704fc6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.168593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b79eb1a4570478886c7526041704fc6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.170568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:19.183564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a9f5dd08-a8a4-4daf-852f-61a06d8cfe8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b79eb1a4570478886c7526041704fc6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.195480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1069/2141] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:18 2022] DELETE /identity/v3/users/0b79eb1a4570478886c7526041704fc6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:19.567714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:19.571548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:19.591125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c71c7-a1b0-4adf-9bc6-67a2c2fb222a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:19.657165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:19.658369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.658754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.659200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] PATH_INFO: `/v3/projects/83ad6c09f1dc4cc792c05d1923f16096` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.661117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ad6c09f1dc4cc792c05d1923f16096)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:19.663503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:19.719262 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ad6c09f1dc4cc792c05d1923f16096', 'request_id': 'req-75377af4-1eba-4cb2-a138-3b2acf221533'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.725858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ad6c09f1dc4cc792c05d1923f16096', 'request_id': 'req-75377af4-1eba-4cb2-a138-3b2acf221533'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.732599 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ad6c09f1dc4cc792c05d1923f16096', 'request_id': 'req-75377af4-1eba-4cb2-a138-3b2acf221533'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.750376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] The token cache is being invalidate because project 83ad6c09f1dc4cc792c05d1923f16096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:19.750802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.751759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75377af4-1eba-4cb2-a138-3b2acf221533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:19.754251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1073/2142] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:19 2022] DELETE /identity/v3/projects/83ad6c09f1dc4cc792c05d1923f16096 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:19.760686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.760996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.761268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.783693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:19.785569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:19.862292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1070/2143] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:19.871085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.871675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.871675 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.893125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:19.894416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:19.903905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1074/2144] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:19.908524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:19.922221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f192bd-6a08-4884-ba2f-a0bb048d5230 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:19.927620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:19.928317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.928706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.929247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.930044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:19.930442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:19.932529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:19.950084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1071/2145] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:19.955234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:19.965909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee9ced-ad86-4a85-84ac-5c39465d85bd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:19.971170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:19.972131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:19.972607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:19.973097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:19.974004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:19.976295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.013705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1075/2146] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:19 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:20.018998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.020579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.022818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:20.033232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47fda7-6bc0-48c2-a218-80035477fe53 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.114910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c7aa4-e48e-4ded-8fbf-21dd212afe60 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.115315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.116285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.116755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.117239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.118408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.119951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.120591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.120866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.121137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] PATH_INFO: `/v3/users/3800f9c3071b4c908b4d378c69953228` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.121803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.122436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3800f9c3071b4c908b4d378c69953228)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.124421 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.127330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:20.160989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1072/2147] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:20 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:20.165697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.176638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c5e74-73a1-423d-aadd-1d63c576416b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.182103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.182730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.183011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.183284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.184119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.185950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.201463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1073/2148] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:20.204519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.207256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3800f9c3071b4c908b4d378c69953228'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:20.221864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d43e7-bf0d-4522-a4d3-cd18a9ddeecf admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.230329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3800f9c3071b4c908b4d378c69953228'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:20.231379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3800f9c3071b4c908b4d378c69953228'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:20.232825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.233238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.233863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.234230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.235157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.237513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.246238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3800f9c3071b4c908b4d378c69953228'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:20.252653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1074/2149] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:20.253989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ec28a9d9-03f6-48c7-bd13-f6da76463c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3800f9c3071b4c908b4d378c69953228'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:20.258292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.260913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:20.300102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cea17-8e8d-46df-8b03-c5840fe34c88 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.302849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1076/2150] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:20 2022] DELETE /identity/v3/users/3800f9c3071b4c908b4d378c69953228 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:20.308552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.310402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.311459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.311639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.311967 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.312536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] PATH_INFO: `/v3/projects/83460a3b21b64624a42777ee11ec6456/users/3bbcfb893efd474ab30f7383fa41c312/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.313717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.350320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:20.351315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=83460a3b21b64624a42777ee11ec6456, user_id=3bbcfb893efd474ab30f7383fa41c312, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.351885 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:20.358548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4e87d-de84-4d35-b5ff-2c08ccc6b96f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.379770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1075/2151] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:20 2022] PUT /identity/v3/projects/83460a3b21b64624a42777ee11ec6456/users/3bbcfb893efd474ab30f7383fa41c312/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:20.399891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.400356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.400789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.448027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] MFA Rules not processed for user `3bbcfb893efd474ab30f7383fa41c312`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:20.450060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:20.461720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1077/2152] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:20.464425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:20.476926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.479412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:20.579507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f42d38-050b-4b93-b43a-51542956ff51 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.606150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1076/2153] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:20.613674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.630391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:20.658547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.659183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.659976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.659976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.758632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba22561-2c33-47ec-b8d8-2c48a0b3a12f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.763993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.764563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.764812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.765023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.765667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.767822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.768624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.770749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.795448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1078/2154] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:20.847853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1077/2155] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:20 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:20.854038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:20.884573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96cee1c-d865-4461-808f-6a97b29c1534 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:20.968605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:20.969243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:20.969570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:20.969847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:20.971610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:20.972582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:20.998125 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1079/2156] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:20 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:21.004077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.022986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078e1c3-7805-439b-a9a5-d52c308201b5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.035129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.035960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.036513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.037114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.038427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.041553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.067460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1078/2157] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:21.068164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.081332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9c1f2d-52d2-4856-924b-3516bd4e446e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.088077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.089029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.089338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.089642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.090337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.092116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.102859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.105111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:21.129341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1080/2158] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:21.133633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51ba39-6837-47ec-a685-b4692398c6be admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.135583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.144001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.145670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.146586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.147291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] PATH_INFO: `/v3/projects/74107e05cf1644fc805625368fca2cbb` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.151143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74107e05cf1644fc805625368fca2cbb)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.153257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.154705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b85304-a66b-4f95-a972-fcf91122d460 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.169839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.174310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.174592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.174873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] PATH_INFO: `/v3/projects/84664056d64141b29688ada424ff0d14/users/707eb4cf85c54ab9a523d8eacd16a873/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.201937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84664056d64141b29688ada424ff0d14, user_id=707eb4cf85c54ab9a523d8eacd16a873, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.206371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee5a47-9abe-4d53-a198-005e75296cf1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.231121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1081/2159] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:21 2022] PUT /identity/v3/projects/84664056d64141b29688ada424ff0d14/users/707eb4cf85c54ab9a523d8eacd16a873/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:21.240099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74107e05cf1644fc805625368fca2cbb', 'request_id': 'req-3635d0ca-40fa-473f-a7ed-5719113d3234'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:21.246670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.247448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.247958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.255563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74107e05cf1644fc805625368fca2cbb', 'request_id': 'req-3635d0ca-40fa-473f-a7ed-5719113d3234'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:21.274086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74107e05cf1644fc805625368fca2cbb', 'request_id': 'req-3635d0ca-40fa-473f-a7ed-5719113d3234'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:21.291615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] MFA Rules not processed for user `707eb4cf85c54ab9a523d8eacd16a873`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:21.294080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:21.294756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] The token cache is being invalidate because project 74107e05cf1644fc805625368fca2cbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:21.295120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:21.296030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-3635d0ca-40fa-473f-a7ed-5719113d3234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:21.298609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1079/2160] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:21 2022] DELETE /identity/v3/projects/74107e05cf1644fc805625368fca2cbb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:21.305744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c28d4-a9e4-4f60-ae76-c2162e516047 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.306307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c28d4-a9e4-4f60-ae76-c2162e516047 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.306792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c28d4-a9e4-4f60-ae76-c2162e516047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.335549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:21.338939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:21.351031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9d4c28d4-a9e4-4f60-ae76-c2162e516047 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:21.353513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9d4c28d4-a9e4-4f60-ae76-c2162e516047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:21.445939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1082/2161] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:21.447127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.448611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:21.454796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1080/2162] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:21.463442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.463793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.463980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.471083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac52ee3-701f-4b07-9816-b72945958e7b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.479608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.480701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.481284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.481844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.482987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.486733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:21.487495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.487948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:21.496982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1081/2163] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:21.501513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.512825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1a230-78b5-46e1-b4ce-3147d6a55d64 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.519121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.519652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.519928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.520200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.520976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:21.521279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.523112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.540902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1082/2164] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:21.541664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.557812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1083/2165] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:21.557812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.561756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b78dc-7f06-4a9e-be6c-2a7f6905b100 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.652994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e71d-5a83-40ca-93ee-578f9a9bcebf admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.656890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.657634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.657963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.658109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.658570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.658847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.658971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.659264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.659660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.659909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.661810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.661957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.689805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1084/2166] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:21.694155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.704939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba68fa0-fc14-4b3f-b9f3-32e04e6002b6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.706667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1083/2167] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:21.711840 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.771709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.772328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.772607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.773617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.774291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.775942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.790634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1085/2168] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:21.792494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.796282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf51565-3ac7-4146-8d0f-d585e2f60d19 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.801226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.801891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.802175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.802445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.803097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.803957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc2fc5-d993-4ad1-b211-e9b64e1cb4e0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.805071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.809690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.810268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.810547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.810821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] PATH_INFO: `/v3/projects/93bee5a159c44b18be01b094681406c4/users/e2910d34e3504c699b48e55af7bc7ee1/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.829355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bee5a159c44b18be01b094681406c4, user_id=e2910d34e3504c699b48e55af7bc7ee1, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.832140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.835614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1084/2169] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:21 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:21.841140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.848487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:21.853220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c970f8-7f92-48d1-8fba-7637e4b2ca61 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.858145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1086/2170] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:21 2022] PUT /identity/v3/projects/93bee5a159c44b18be01b094681406c4/users/e2910d34e3504c699b48e55af7bc7ee1/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:21.859861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.886136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:21.948132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207b8c-be94-4ace-8f6b-86a6f396f33e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.953200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.953747 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.954022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.954293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.954948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.956563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.964078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:21.964709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:21.964988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:21.965299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:21.965980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:21.967626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:21.976309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1087/2171] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:21.977502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.982341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1085/2172] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:21.983490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:21.995076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c7cad-8a7c-4ece-89cb-939ec42ba03e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:21.996428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9277544c-a435-4ff2-b0b6-539734e8876a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:22.000054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:22.000683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.000973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.001257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.001923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:22.002572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:22.003290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.003554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:22.003828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.004292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] PATH_INFO: `/v3/projects/93bee5a159c44b18be01b094681406c4/users/e2910d34e3504c699b48e55af7bc7ee1/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.007475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93bee5a159c44b18be01b094681406c4, user_id=e2910d34e3504c699b48e55af7bc7ee1, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:22.011162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f6001-11fe-48b3-9ea8-277b16986b4f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:22.017641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1086/2173] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:22.022140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:22.025839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1088/2174] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:21 2022] PUT /identity/v3/projects/93bee5a159c44b18be01b094681406c4/users/e2910d34e3504c699b48e55af7bc7ee1/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:22.037651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.038063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.038364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.043450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2883110-0df0-4dd0-af14-f48305ad89ac admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:22.072172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] MFA Rules not processed for user `e2910d34e3504c699b48e55af7bc7ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:22.073551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:22.115079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:22.115742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.115990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.116269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] PATH_INFO: `/v3/projects/ac7bf59244bc487b84c7dbf9aa7314d2/users/2f931e726872474dae2b7b6fbb0eb644/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.140543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7bf59244bc487b84c7dbf9aa7314d2, user_id=2f931e726872474dae2b7b6fbb0eb644, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:22.145682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79433c9-5255-469e-8448-2113d92e3227 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:22.161860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1087/2175] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:22 2022] PUT /identity/v3/projects/ac7bf59244bc487b84c7dbf9aa7314d2/users/2f931e726872474dae2b7b6fbb0eb644/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:22.167029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.167301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.167573 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.191722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1089/2176] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:22.196813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:22.198110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:22.204643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:22.206738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:22.288611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf3d6c-9667-4740-8ddb-1970887c2fc8 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:22.292299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1088/2177] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:22.306198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:22.308367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:22.326121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:22.349464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:22.376105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:22.376821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.376994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.377306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.379249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:22.389547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e488c-e420-4b13-8aff-1a1cc87ea694 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:22.397022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:22.398165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:22.398619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:22.399059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:22.420549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:22.422233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d2aac-4c27-4801-8a2c-5bb44d79a7c0 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:22.437897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1089/2178] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:22.483522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:22.485124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:22.497689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1090/2179] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:23.602096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:23.602544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:23.602803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:23.659913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] MFA Rules not processed for user `2f931e726872474dae2b7b6fbb0eb644`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:23.674327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:23.820433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1090/2180] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:23.835272 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:23.838583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:23.859076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341882d-9d22-455f-b2ee-6dc61c3132b5 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:23.864156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:23.864788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:23.865067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:23.865344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:23.876768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:23.878481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:23.899573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1091/2181] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:24.384705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:24.395901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9336-1364-4310-966a-1e0aba53a09f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:24.399618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:24.400278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:24.400548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:24.400819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:24.473033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:24.474729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5e89-c131-4991-88cb-8f36742fd017 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:24.484491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1091/2182] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:25.170901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:25.180146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11299789-a81a-4740-8df2-d8783adc6986 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:25.184533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:25.185135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:25.185419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:25.185820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:25.250928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:25.252386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:25.263592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1092/2183] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:25.370659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144aed-c30a-48c3-a3fd-c49b46a2760c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:25.371186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144aed-c30a-48c3-a3fd-c49b46a2760c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:25.371374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144aed-c30a-48c3-a3fd-c49b46a2760c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:25.393949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-21144aed-c30a-48c3-a3fd-c49b46a2760c None None] MFA Rules not processed for user `2f931e726872474dae2b7b6fbb0eb644`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:25.395241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-21144aed-c30a-48c3-a3fd-c49b46a2760c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:25.403295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1092/2184] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:29.357080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:29.370996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82c5cd-843e-4f07-abed-6115767931f0 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:29.376925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:29.377615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:29.377894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:29.378165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] PATH_INFO: `/v3/users/3bbcfb893efd474ab30f7383fa41c312` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:29.379472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbcfb893efd474ab30f7383fa41c312)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:29.381832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:29.445752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbcfb893efd474ab30f7383fa41c312'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:29.462498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbcfb893efd474ab30f7383fa41c312'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:29.463246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbcfb893efd474ab30f7383fa41c312'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:29.465248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:29.475022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbcfb893efd474ab30f7383fa41c312'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:29.476521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbcfb893efd474ab30f7383fa41c312'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:29.493513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1093/2185] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:29 2022] DELETE /identity/v3/users/3bbcfb893efd474ab30f7383fa41c312 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:29.497654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:29.498206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:29.498432 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:29.522712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:29.524965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:29.587790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:29.628508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1093/2186] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:29.636094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:29.637802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:29.699791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f85dc-1479-49bb-a365-a7d01cbbe47e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:29.703654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:29.704263 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:29.704541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:29.704814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:29.714814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:29.716389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:29.728407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1094/2187] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:30.013576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:30.014987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:30.029823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49399801-098f-4ce3-aea4-4cb3049ec4bd None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:30.036437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:30.037060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:30.037340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:30.037703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] PATH_INFO: `/v3/projects/83460a3b21b64624a42777ee11ec6456` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:30.038821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=83460a3b21b64624a42777ee11ec6456)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:30.041315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:30.093964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83460a3b21b64624a42777ee11ec6456', 'request_id': 'req-68510afc-b839-46fe-8a36-7f67c42c9c2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.103367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83460a3b21b64624a42777ee11ec6456', 'request_id': 'req-68510afc-b839-46fe-8a36-7f67c42c9c2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.110281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83460a3b21b64624a42777ee11ec6456', 'request_id': 'req-68510afc-b839-46fe-8a36-7f67c42c9c2b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.120739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] The token cache is being invalidate because project 83460a3b21b64624a42777ee11ec6456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:30.121099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.121749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.123284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1094/2188] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:30 2022] DELETE /identity/v3/projects/83460a3b21b64624a42777ee11ec6456 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:30.127734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:30.137910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97e58-6f2f-436b-ab5b-b541d9ad181d service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:30.197087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:30.197743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:30.198019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:30.198290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] PATH_INFO: `/v3/users/707eb4cf85c54ab9a523d8eacd16a873` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:30.199699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=707eb4cf85c54ab9a523d8eacd16a873)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:30.201734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:30.264559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707eb4cf85c54ab9a523d8eacd16a873'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.282704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707eb4cf85c54ab9a523d8eacd16a873'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.283727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707eb4cf85c54ab9a523d8eacd16a873'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.295123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707eb4cf85c54ab9a523d8eacd16a873'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.297297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707eb4cf85c54ab9a523d8eacd16a873'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.312002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1095/2189] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:30 2022] DELETE /identity/v3/users/707eb4cf85c54ab9a523d8eacd16a873 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:30.725182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:30.727202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:30.741837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68510afc-b839-46fe-8a36-7f67c42c9c2b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:30.817859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:30.818568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:30.818869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:30.819141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] PATH_INFO: `/v3/projects/84664056d64141b29688ada424ff0d14` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:30.820376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] RBAC: Authorizing `identity:delete_project(project_id=84664056d64141b29688ada424ff0d14)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:30.822513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:30.878241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84664056d64141b29688ada424ff0d14', 'request_id': 'req-9cf76504-fb72-4fbd-8ae3-be063e4d950c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.887921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84664056d64141b29688ada424ff0d14', 'request_id': 'req-9cf76504-fb72-4fbd-8ae3-be063e4d950c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.896981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84664056d64141b29688ada424ff0d14', 'request_id': 'req-9cf76504-fb72-4fbd-8ae3-be063e4d950c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.898607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:30.913628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] The token cache is being invalidate because project 84664056d64141b29688ada424ff0d14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:30.913989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.914547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:30.916552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1095/2190] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:30 2022] DELETE /identity/v3/projects/84664056d64141b29688ada424ff0d14 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:30.921064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:30.922979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:30.934873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:30.940860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5fd8d-34d0-4a47-8e5c-f356dd8cc1af admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:31.015002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:31.015730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:31.016224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:31.016612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] PATH_INFO: `/v3/users/e2910d34e3504c699b48e55af7bc7ee1` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:31.018557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2910d34e3504c699b48e55af7bc7ee1)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:31.021588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:31.081032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2910d34e3504c699b48e55af7bc7ee1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.100596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2910d34e3504c699b48e55af7bc7ee1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.101708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2910d34e3504c699b48e55af7bc7ee1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.110714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2910d34e3504c699b48e55af7bc7ee1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.111462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-13e4e58e-e799-4d2b-ade8-413087d7e154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2910d34e3504c699b48e55af7bc7ee1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.126238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1096/2191] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:30 2022] DELETE /identity/v3/users/e2910d34e3504c699b48e55af7bc7ee1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:31.464429 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:31.466094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:31.491418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf76504-fb72-4fbd-8ae3-be063e4d950c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:31.632448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:31.633477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:31.634818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:31.635325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] PATH_INFO: `/v3/projects/93bee5a159c44b18be01b094681406c4` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:31.637552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=93bee5a159c44b18be01b094681406c4)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:31.639603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:31.737072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93bee5a159c44b18be01b094681406c4', 'request_id': 'req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.749999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93bee5a159c44b18be01b094681406c4', 'request_id': 'req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.758428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93bee5a159c44b18be01b094681406c4', 'request_id': 'req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.778024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] The token cache is being invalidate because project 93bee5a159c44b18be01b094681406c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:31.778024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.781129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-ff1f9182-8ca1-4cae-a682-f2ea417a3c1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:31.782797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1096/2192] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:31 2022] DELETE /identity/v3/projects/93bee5a159c44b18be01b094681406c4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:31.787622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:31.787970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:31.788389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:31.821832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:31.824152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:31.983987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1097/2193] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:31.987086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:31.987264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:31.987629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.029345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:32.032398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:32.050066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1097/2194] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:32.054390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.067156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb52b7-8715-423b-ba0f-df2a41ec61a3 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.073516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.074220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.074519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.074827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.075913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:32.076225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.078029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.092892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1098/2195] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:32.102077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.112642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c067cdb-733b-4608-9768-a30467a33468 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.124025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.125290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.125290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.125733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.126255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.128472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.167927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1098/2196] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:32 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:32.173072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.186394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371ecef-0fce-4bb2-a431-3f6413e90e37 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.196757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:32.265723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.266367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.266639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.267215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.267871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.269956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.297567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1099/2197] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:32 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:32.302022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.318958 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8e276-453c-4dab-9029-62fee8fc58d6 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.338143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.338924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.339332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.339719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.340711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.342890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.355401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1099/2198] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:32.360808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.370138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0707986-5163-44c6-9ec4-36e41145a462 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.375392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.376025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.376301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.376574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.377250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.378971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35923116-7f5b-43b3-9c05-e89db4ccc41b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.391642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1100/2199] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:32.396660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.411263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6f8c1-4afb-492c-8a9e-2a1aadb5aad7 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.416801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.418277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.418628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.418751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] PATH_INFO: `/v3/projects/dc773cb84f6344ab8a373a7176fa618a/users/b5f3d1bcb1ab46669c226b72573c4083/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.441766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc773cb84f6344ab8a373a7176fa618a, user_id=b5f3d1bcb1ab46669c226b72573c4083, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.446397 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.478966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1100/2200] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:32 2022] PUT /identity/v3/projects/dc773cb84f6344ab8a373a7176fa618a/users/b5f3d1bcb1ab46669c226b72573c4083/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:32.482843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f51e-841f-45ff-8014-9118245a6cc7 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.483148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f51e-841f-45ff-8014-9118245a6cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.483515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c019f51e-841f-45ff-8014-9118245a6cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.526757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c019f51e-841f-45ff-8014-9118245a6cc7 None None] MFA Rules not processed for user `b5f3d1bcb1ab46669c226b72573c4083`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:32.528343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c019f51e-841f-45ff-8014-9118245a6cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:32.644572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1101/2201] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:32.657178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:32.668153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:32.712449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:32.780503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39d81b-7c4a-4183-a152-1f82b10ab8a9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:32.788394 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:32.789846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:32.790403 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:32.790877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:32.804785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:32.806962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494116c-1892-453f-b356-512c5ceff364 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:32.821722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1101/2202] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:33.239298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:33.240883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:33.242055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:33.244687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1102/2203] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:22:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:22:33.344531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:33.346311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:33.346781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:33.423758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:33.434947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:33.489903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:33.492337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:33.578570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1102/2204] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:22:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:33.593702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:33.595747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:33.613430 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f97b38-ed1f-4719-b749-7887cf171e97 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:33.620137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:33.620771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:33.621052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:33.621448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:33.635588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:33.640035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:33.657615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1103/2205] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:33.664067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee03ec-66cc-402d-bdd3-b74445d6bcd5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:33.671203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:33.672680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:33.673910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:33.677591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] PATH_INFO: `/v3/users/1bc3be23405d4ae88dd46d656ad6a3c8` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:33.682895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc3be23405d4ae88dd46d656ad6a3c8)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:33.685668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:33.726790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:33.773316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc3be23405d4ae88dd46d656ad6a3c8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:33.787528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc3be23405d4ae88dd46d656ad6a3c8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:33.788382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc3be23405d4ae88dd46d656ad6a3c8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:33.798079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc3be23405d4ae88dd46d656ad6a3c8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:33.798829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc3be23405d4ae88dd46d656ad6a3c8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:33.812752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1103/2206] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:33 2022] DELETE /identity/v3/users/1bc3be23405d4ae88dd46d656ad6a3c8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:34.003246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:34.015443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e322cb-eb93-465e-8b45-d955c490501c service placement] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:34.085522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:34.086067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:34.086341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:34.086611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] PATH_INFO: `/v3/projects/bcc715590f88432d9b6e7dd779ad5851` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:34.087745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc715590f88432d9b6e7dd779ad5851)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:34.089734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:34.136558 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:34.141593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc715590f88432d9b6e7dd779ad5851', 'request_id': 'req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.150286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc715590f88432d9b6e7dd779ad5851', 'request_id': 'req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.157137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc715590f88432d9b6e7dd779ad5851', 'request_id': 'req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.169314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] The token cache is being invalidate because project bcc715590f88432d9b6e7dd779ad5851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:34.169648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.170379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.172130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1104/2207] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:34 2022] DELETE /identity/v3/projects/bcc715590f88432d9b6e7dd779ad5851 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:34.176370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:34.178132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:34.192348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987bfae-6fdb-456f-a306-676b0ecbf79e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:34.255752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:34.256386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:34.256662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:34.256925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] PATH_INFO: `/v3/users/034af51e97114888b182417898d7ca5f` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:34.258230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=034af51e97114888b182417898d7ca5f)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:34.260152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:34.315346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034af51e97114888b182417898d7ca5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.329935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034af51e97114888b182417898d7ca5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.330683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034af51e97114888b182417898d7ca5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.349485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034af51e97114888b182417898d7ca5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.350101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ddd62ad7-badd-4104-bafc-9e078f5980ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034af51e97114888b182417898d7ca5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:34.363998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1104/2208] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:34 2022] DELETE /identity/v3/users/034af51e97114888b182417898d7ca5f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:34.618022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:34.619632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:34.646239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c76ef-1e58-4fc3-ad5c-ddee9d24f17c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:34.892785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:34.895438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:34.895832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:34.896321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] PATH_INFO: `/v3/projects/e25aa725759446189483213bcb765eb2` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:34.901131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25aa725759446189483213bcb765eb2)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:34.909730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.039009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25aa725759446189483213bcb765eb2', 'request_id': 'req-6c2a6795-9d10-49ed-9111-c63c46956c6f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:35.049085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25aa725759446189483213bcb765eb2', 'request_id': 'req-6c2a6795-9d10-49ed-9111-c63c46956c6f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:35.060404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25aa725759446189483213bcb765eb2', 'request_id': 'req-6c2a6795-9d10-49ed-9111-c63c46956c6f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:35.086926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] The token cache is being invalidate because project e25aa725759446189483213bcb765eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:35.087227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:35.087904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c2a6795-9d10-49ed-9111-c63c46956c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:35.089883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1105/2209] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:34 2022] DELETE /identity/v3/projects/e25aa725759446189483213bcb765eb2 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:35.094554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.094844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.095145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.119151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:35.121124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:35.134003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:35.188217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1105/2210] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:35.196567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.196893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.197169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.218507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:35.219778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:35.228057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1106/2211] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:35.232490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.242818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23eb781-ed04-4fcd-bc14-ad74266cb84f None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.247946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.248646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.249030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.249416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.250220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:35.250612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.252677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.265203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1106/2212] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:35.270332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.280373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110ae6c-b24d-4c3e-845a-d0ef54904565 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.286248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.286863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.287141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.287408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.288061 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.290057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.322404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1107/2213] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:35 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:35.327270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.338304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885d5717-a71b-4747-b9c1-7930e8509d0f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.413352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.414498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.414942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.415210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.416206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.418529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.446851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1107/2214] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:35 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:35.452289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.465263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335b70e-18b2-4cbd-a7c8-934a6a061fc8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.473993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.474732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.475194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.475532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.476352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.478090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.489253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1108/2215] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:35.493550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.503992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbffd40-6b6b-4c2d-bc92-932df758e6aa admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.509186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.509865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.510159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.510420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.511205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.512820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dc8ca-97f3-4e89-9252-3deed065f945 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.525051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1108/2216] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:35.530156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.543713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9e25-c163-48c7-9003-e74dddc3782c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.551092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.553019 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.553733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.554112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] PATH_INFO: `/v3/projects/adcdcbea2a39454c8287bf71d6231839/users/1bdd9d25f8f34f8bad928132622a859f/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.576916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcdcbea2a39454c8287bf71d6231839, user_id=1bdd9d25f8f34f8bad928132622a859f, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.580520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.590422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:35.597673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1109/2217] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:35 2022] PUT /identity/v3/projects/adcdcbea2a39454c8287bf71d6231839/users/1bdd9d25f8f34f8bad928132622a859f/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:35.610364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588ff24-aa1f-4032-b2a1-300aef29961a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.610654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588ff24-aa1f-4032-b2a1-300aef29961a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.611061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588ff24-aa1f-4032-b2a1-300aef29961a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.650752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4588ff24-aa1f-4032-b2a1-300aef29961a None None] MFA Rules not processed for user `1bdd9d25f8f34f8bad928132622a859f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:35.651898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4588ff24-aa1f-4032-b2a1-300aef29961a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:35.738455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1109/2218] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:35.749691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:35.751442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:35.812753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb5e13-f8a5-4408-8dba-232d3078f5e2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:35.817211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:35.817867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:35.818153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:35.818399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:35.829376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:35.831337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:35.843699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1110/2219] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:37.941060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882535b-5455-46f5-a2db-b48a7b7f0a89 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:37.941557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882535b-5455-46f5-a2db-b48a7b7f0a89 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:37.941764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882535b-5455-46f5-a2db-b48a7b7f0a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:37.980731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b882535b-5455-46f5-a2db-b48a7b7f0a89 None None] MFA Rules not processed for user `4a6f819365574091ae344f14e47f487f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:37.982099 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b882535b-5455-46f5-a2db-b48a7b7f0a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:37.999010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:38.069846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1110/2220] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:40.591299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:40.592808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:40.663207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa48893-310f-40c2-909c-b94e3ee01e34 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:40.667751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:40.669730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:40.670024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:40.670303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] PATH_INFO: `/v3/users/1ba1e9c169524ac0972880ad05bb4153` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:40.671674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba1e9c169524ac0972880ad05bb4153)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:40.673726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:40.748527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba1e9c169524ac0972880ad05bb4153'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:40.762193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba1e9c169524ac0972880ad05bb4153'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:40.791611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba1e9c169524ac0972880ad05bb4153'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:40.793028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba1e9c169524ac0972880ad05bb4153'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:40.813286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba1e9c169524ac0972880ad05bb4153'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:40.830702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1111/2221] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:40 2022] DELETE /identity/v3/users/1ba1e9c169524ac0972880ad05bb4153 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:40.833233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:40.834103 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:40.834554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:40.861457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:40.863140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:40.939975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1111/2222] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:40.950083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:40.951510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:40.974817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:41.017882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb3543-a9ca-48f1-adda-9ae9dc26c148 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:41.022204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:41.022824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.023101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.023409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.033507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:41.035004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af5f19-be2c-4818-8aa7-e7c3dc024c4e service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:41.045016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1112/2223] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:41.521085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:41.522950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:41.535813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857fdc1-de66-43c0-9766-e1706e19106b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:41.541129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:41.541943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.542334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.542612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] PATH_INFO: `/v3/projects/8f1b35218c96457ba17be2631e29cfe8` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.544299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1b35218c96457ba17be2631e29cfe8)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:41.546727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:41.620585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1b35218c96457ba17be2631e29cfe8', 'request_id': 'req-0b385104-8ad5-4e93-bbea-1edcd80fc175'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.627968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1b35218c96457ba17be2631e29cfe8', 'request_id': 'req-0b385104-8ad5-4e93-bbea-1edcd80fc175'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.636007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1b35218c96457ba17be2631e29cfe8', 'request_id': 'req-0b385104-8ad5-4e93-bbea-1edcd80fc175'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.658868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] The token cache is being invalidate because project 8f1b35218c96457ba17be2631e29cfe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:41.659161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.660030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0b385104-8ad5-4e93-bbea-1edcd80fc175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.661677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1112/2224] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:41 2022] DELETE /identity/v3/projects/8f1b35218c96457ba17be2631e29cfe8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:41.667115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.667115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.667899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.692959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:41.694631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:41.787689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1113/2225] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:41.796425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.796715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.796990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.817904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:41.819146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:41.827416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1113/2226] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:41.835251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:41.847983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4da273-164f-4627-95d0-1b961aabd64d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:41.853763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:41.856438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.856438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.856438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.856438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:41.856438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:41.858588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:41.869373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:41.871944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:41.880933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1114/2227] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:41.886176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:41.891676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7f16-8b7a-4705-b3d7-43293928a25b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:41.896829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:41.897602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.897764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.898021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] PATH_INFO: `/v3/users/1bdd9d25f8f34f8bad928132622a859f` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.899208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bdd9d25f8f34f8bad928132622a859f)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:41.901165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:41.903207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea21fd-a3b5-4336-96a6-dd3b70c96a99 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:41.908268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:41.908903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:41.909181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:41.909481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:41.910123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:41.912072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:41.945905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:41.949606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1115/2228] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:41 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:41.951027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:41.969142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bdd9d25f8f34f8bad928132622a859f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.987554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bdd9d25f8f34f8bad928132622a859f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.988447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bdd9d25f8f34f8bad928132622a859f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.997688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bdd9d25f8f34f8bad928132622a859f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:41.998443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-6c242b09-970f-4c22-ab70-2be07a4e2e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bdd9d25f8f34f8bad928132622a859f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:42.016459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1114/2229] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:41 2022] DELETE /identity/v3/users/1bdd9d25f8f34f8bad928132622a859f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:42.022183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4187-23e8-469b-9640-629e59c22131 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.022384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4187-23e8-469b-9640-629e59c22131 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.022638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4187-23e8-469b-9640-629e59c22131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.030409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3ff7-7d0d-4a58-9b94-eb4c19e6ae05 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.050249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-729b4187-23e8-469b-9640-629e59c22131 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:42.051534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-729b4187-23e8-469b-9640-629e59c22131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.075898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:42.100414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.101064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.101664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.101664 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.102245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.104197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.132398 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1115/2230] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:42.138164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1116/2231] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:41 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:42.143543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4187-23e8-469b-9640-629e59c22131 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.143842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.145703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-729b4187-23e8-469b-9640-629e59c22131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.145956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.162088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4187-23e8-469b-9640-629e59c22131 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.168551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.169249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.169633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.170191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.170957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.172920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.193163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1116/2232] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:42.199209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.210556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65af16e-55a1-460f-8b3f-01131ee81d8c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.215716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.216325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.216583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.216934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.217671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.221041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.231344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcb48f-0dbc-450a-8242-ca3effde0d17 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.233984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1117/2233] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:42.236562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.237380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.237738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.238016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.240195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.257461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.257676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5b6dd-6663-4a67-91ab-a84eb5585877 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.259076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e16e1-104f-4850-b12b-aa75eb9275c1 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.266008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.266008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.266386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.266517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] PATH_INFO: `/v3/projects/6eef8601b31a4eb7b9ab08cf88d170dc/users/ab129d733530484e970e8f47a400ef63/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.272400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1117/2234] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:22:42.288170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eef8601b31a4eb7b9ab08cf88d170dc, user_id=ab129d733530484e970e8f47a400ef63, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.291134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.329505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1118/2235] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:42 2022] PUT /identity/v3/projects/6eef8601b31a4eb7b9ab08cf88d170dc/users/ab129d733530484e970e8f47a400ef63/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:42.339818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.340113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.340491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.382063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] MFA Rules not processed for user `ab129d733530484e970e8f47a400ef63`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:42.383345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.482220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1118/2236] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:42 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:42.498541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.500500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.600437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19d2d8-02c1-46f1-922d-36d81edde1c4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.604462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.605078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.605405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.605691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.614872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.616337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c19e5-0fa2-4741-8997-cecad698e323 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.628256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1119/2237] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:42.700097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:42.701675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:42.796836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:42.806242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d807c-5661-4f2e-8f3e-74270b2d1cb1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:42.812853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:42.813926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:42.814394 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:42.814831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] PATH_INFO: `/v3/projects/adcdcbea2a39454c8287bf71d6231839` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:42.816589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcdcbea2a39454c8287bf71d6231839)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:42.822642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:42.906977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcdcbea2a39454c8287bf71d6231839', 'request_id': 'req-52dfaf25-036c-4899-95ee-55315f117519'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:42.941451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcdcbea2a39454c8287bf71d6231839', 'request_id': 'req-52dfaf25-036c-4899-95ee-55315f117519'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:42.966379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcdcbea2a39454c8287bf71d6231839', 'request_id': 'req-52dfaf25-036c-4899-95ee-55315f117519'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:43.003539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] The token cache is being invalidate because project adcdcbea2a39454c8287bf71d6231839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:43.004017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:43.014015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-52dfaf25-036c-4899-95ee-55315f117519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:43.016402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1119/2238] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:42 2022] DELETE /identity/v3/projects/adcdcbea2a39454c8287bf71d6231839 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:43.023464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.024000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.024370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.035290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:43.052039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:43.053008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:43.138380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1120/2239] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:22:43.145105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.145369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.145762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.172065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:43.173268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:43.182009 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1120/2240] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:43.186563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.197566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8114c1d-bdde-4fc2-ac7c-a4c07cb84f95 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.204336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.205232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.205642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.206079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.208131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:43.208530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.211115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.226043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1121/2241] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:43.231657 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.245445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4bdf1-d86c-453f-9e22-7335092371e0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.252428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.253787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.254286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.254812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.255742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.258536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.325169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1121/2242] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:43 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:22:43.327674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.338867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25a09f-13ba-4d10-a915-f5e3ca9be18a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.431215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.431848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.432122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.432392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.433026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.435163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.458992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1122/2243] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:43 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:43.463438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.475607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8d882-67b2-4e66-ac19-3cf2e0ea6536 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.480888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.481600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.481878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.482147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.482816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.485133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.497641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1122/2244] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:43.501533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.512352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbe590-1cec-4df7-b68d-c2698f2e15f5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.517577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.518408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.518684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.518958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.519613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.521278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc277df7-2454-43f0-9aa3-98a8c57e3ea5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.537830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1123/2245] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:22:43.539145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.550175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7dd9-d953-40d5-a70e-c18bd7d1bb81 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.555598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.556389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.556717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.556999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] PATH_INFO: `/v3/projects/874b95fbcdbe47e1a8f1f330d792128d/users/67155053792c4941a92a06f9a92cab7b/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.576307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=874b95fbcdbe47e1a8f1f330d792128d, user_id=67155053792c4941a92a06f9a92cab7b, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.579216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.604540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1123/2246] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:43 2022] PUT /identity/v3/projects/874b95fbcdbe47e1a8f1f330d792128d/users/67155053792c4941a92a06f9a92cab7b/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:43.622385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.622705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.622933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.661847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] MFA Rules not processed for user `67155053792c4941a92a06f9a92cab7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:43.663943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:43.796077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:43.805596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1124/2247] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:43.817658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:43.820993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:43.904282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d07cf-4cbf-49f4-99c4-bc9c65c249aa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:43.907836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:43.908476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:43.908760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:43.909037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:43.917978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:43.919445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66104d6-d036-429d-aa26-6965dd5af81f service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:43.930179 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1124/2248] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:44.073329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:44.074889 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:44.173863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cd5cd-1c50-47e1-86fb-9c428a37635f None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:44.181369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:44.182533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:44.182895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:44.183278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] PATH_INFO: `/v3/users/b5f3d1bcb1ab46669c226b72573c4083` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:44.184877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f3d1bcb1ab46669c226b72573c4083)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:44.187984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:44.288485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f3d1bcb1ab46669c226b72573c4083'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:44.314467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f3d1bcb1ab46669c226b72573c4083'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:44.316871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f3d1bcb1ab46669c226b72573c4083'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:44.339654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f3d1bcb1ab46669c226b72573c4083'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:44.340534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f3d1bcb1ab46669c226b72573c4083'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:44.362907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:44.363203 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:44.363481 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:44.367060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1125/2249] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:44 2022] DELETE /identity/v3/users/b5f3d1bcb1ab46669c226b72573c4083 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:44.385735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:44.388124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:44.420872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:44.561548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1125/2250] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:44.574835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:44.576817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:44.718143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403ffe-4798-43a0-9c84-524dea054087 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:44.723443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:44.724888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:44.725594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:44.726029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:44.737567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:44.739489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a616e6-a668-4681-9055-5e1ca102c984 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:44.760331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1126/2251] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:45.496738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:45.499029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:45.536679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54113668-11fd-4749-b4cb-640ee59cb7a1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:45.544888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:45.545513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:45.545876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:45.546384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] PATH_INFO: `/v3/projects/dc773cb84f6344ab8a373a7176fa618a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:45.548034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc773cb84f6344ab8a373a7176fa618a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:45.565381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:45.692281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc773cb84f6344ab8a373a7176fa618a', 'request_id': 'req-b4fd24e6-5273-4e3a-a032-90ee3274fd02'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:45.705827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc773cb84f6344ab8a373a7176fa618a', 'request_id': 'req-b4fd24e6-5273-4e3a-a032-90ee3274fd02'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:45.726102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc773cb84f6344ab8a373a7176fa618a', 'request_id': 'req-b4fd24e6-5273-4e3a-a032-90ee3274fd02'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:45.771599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] The token cache is being invalidate because project dc773cb84f6344ab8a373a7176fa618a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:45.771948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:45.773714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b4fd24e6-5273-4e3a-a032-90ee3274fd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:45.775745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1126/2252] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:45 2022] DELETE /identity/v3/projects/dc773cb84f6344ab8a373a7176fa618a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:45.780670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:45.781152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:45.781232 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:45.807152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:45.808688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:45.854399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:45.966124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1127/2253] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:45.975717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:45.975923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:45.976214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.025345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:46.031583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:46.057903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1127/2254] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:46.066555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.094173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d10071-1d9b-4db2-afaa-1d7fe3c3d447 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.099245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.100257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.100536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.100803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.102171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:46.102477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.114230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.143667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1128/2255] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:22:46.155705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.173109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c876e-ac50-4303-91bc-02173a5f81b2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.182560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.183196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.183567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.183833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.184446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.186474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.230989 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1128/2256] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:46 2022] POST /identity/v3/projects => generated 381 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:46.232239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.247509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c2ec0-4b3f-4ab6-bb27-0c96339d7f00 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.359728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.360457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.360739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.361005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.361701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.364268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.391661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1129/2257] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:46 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:46.400348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.411461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bfc66e-c767-4e66-b2eb-1cb3eb8bce72 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.418089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.419038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.419544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.420086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.420973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.422831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.435331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1129/2258] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:46.439810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.450778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782539aa-f5b1-44d0-91e2-0df4026b91c3 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.455632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.456334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.456786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.457082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.457835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.459555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96351811-9aae-4ab3-b52a-e92e5e5fb1c5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.470876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1130/2259] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:46.475072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.485478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed795eeb-1bb7-4b4a-81cb-487e009fed18 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.490153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.490812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.491090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.491364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] PATH_INFO: `/v3/projects/fe4f956d4d27437c830871f6634a3018/users/931dcabba0214e3daa878f31cd1706cc/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.506074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4f956d4d27437c830871f6634a3018, user_id=931dcabba0214e3daa878f31cd1706cc, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.508734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.522459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1130/2260] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:46 2022] PUT /identity/v3/projects/fe4f956d4d27437c830871f6634a3018/users/931dcabba0214e3daa878f31cd1706cc/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:46.527671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.527955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.528227 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.547303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:46.548518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:46.613336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1131/2261] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:46.623576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:46.625483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:46.685673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:46.692907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb55690-42b4-4396-b121-eab7a0482788 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:46.697656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:46.698280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:46.698697 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:46.699214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:46.708904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:46.710662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c3095-eeb3-4bbf-9583-b237471b69e0 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:46.722391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1131/2262] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:48.409671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:48.411403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:48.462863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e06e-bd53-4b29-b74b-4c1e0bdc0c25 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:48.485296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:48.487252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:48.487783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:48.488307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] PATH_INFO: `/v3/users/ab129d733530484e970e8f47a400ef63` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:48.490332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab129d733530484e970e8f47a400ef63)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:48.497530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:48.554294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:48.619893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab129d733530484e970e8f47a400ef63'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:48.646662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab129d733530484e970e8f47a400ef63'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:48.647549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab129d733530484e970e8f47a400ef63'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:48.659517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab129d733530484e970e8f47a400ef63'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:48.660433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab129d733530484e970e8f47a400ef63'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:48.706743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1132/2263] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:22:48 2022] DELETE /identity/v3/users/ab129d733530484e970e8f47a400ef63 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:48.709275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:48.709830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:48.712480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:48.756795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:48.759435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:48.883433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1132/2264] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:48.954906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:48.958686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:49.085366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7397b-595f-4f1b-8a26-7bc02b87a212 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:49.092328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:49.093461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:49.093461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:49.093845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:49.107458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:49.108988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb6175-f00b-4bea-aa25-29c1ca524cec service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:49.123606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1133/2265] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:50.249490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:50.251109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:50.283170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ad2c9-0651-4473-894d-6ada83fccf0d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:50.343540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:50.344611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:50.345104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:50.345656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] PATH_INFO: `/v3/projects/6eef8601b31a4eb7b9ab08cf88d170dc` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:50.347557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eef8601b31a4eb7b9ab08cf88d170dc)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:50.349773 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:50.458265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eef8601b31a4eb7b9ab08cf88d170dc', 'request_id': 'req-302fb7c8-5642-4e9c-b267-e349dd8a34d1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:50.475026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eef8601b31a4eb7b9ab08cf88d170dc', 'request_id': 'req-302fb7c8-5642-4e9c-b267-e349dd8a34d1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:50.503647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eef8601b31a4eb7b9ab08cf88d170dc', 'request_id': 'req-302fb7c8-5642-4e9c-b267-e349dd8a34d1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:50.517962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] The token cache is being invalidate because project 6eef8601b31a4eb7b9ab08cf88d170dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:22:50.518577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:50.520493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-302fb7c8-5642-4e9c-b267-e349dd8a34d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:22:50.523257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1133/2266] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:22:50 2022] DELETE /identity/v3/projects/6eef8601b31a4eb7b9ab08cf88d170dc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:50.534863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:50.535814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:50.536270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:50.577724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:50.579020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:50.721344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1134/2267] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:50.729001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:50.729276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:50.729583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:50.763550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:50.765805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:50.776289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1134/2268] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:50.780965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:50.794863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce889c-9a62-4923-a845-e3c65aa6e8af None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:50.801047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:50.801766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:50.802086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:50.802493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:50.803108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:22:50.803705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:50.805882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:50.820592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1135/2269] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:22:50.825337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:50.863067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea0357-14f1-40eb-8c74-7d0f991e0c99 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:50.869282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:50.870158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:50.870811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:50.871459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:50.872603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:50.875378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:50.913766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1135/2270] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:50 2022] POST /identity/v3/projects => generated 371 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:50.922665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:50.936828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7e350-9474-4ee8-85c8-ea0256eb6cfb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:50.995884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:51.034840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:51.035661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.036403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.036733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.037758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:51.040763 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:51.079494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1136/2271] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:50 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:51.081064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:51.092142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26868d22-9a06-4ee2-a508-6cc21ccb7060 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:51.096871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:51.098186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.098461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.098741 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.099473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:51.101782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:51.113616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1136/2272] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:51.117999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:51.131939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787bc0c-4e4b-48ac-b5fa-1cb7b410dfe6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:51.137718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:51.138342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.138616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.138883 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.139645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:51.141203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f9a021-9a48-4fee-9305-e8d0b3fb5c13 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:51.153960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1137/2273] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:51.158036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:51.169109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c93e17-7ddb-47c5-8cf0-03285a6548d3 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:51.175719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:51.176407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.176829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.177133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] PATH_INFO: `/v3/projects/fd2d4ae1c228446eb5bfc64d44348fdf/users/ef7f53d57f3544e5a25e1beeddab9af4/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.194409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2d4ae1c228446eb5bfc64d44348fdf, user_id=ef7f53d57f3544e5a25e1beeddab9af4, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:51.197093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:51.212290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1137/2274] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:51 2022] PUT /identity/v3/projects/fd2d4ae1c228446eb5bfc64d44348fdf/users/ef7f53d57f3544e5a25e1beeddab9af4/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:51.217558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a65fa-e43d-4ddd-a966-bc0d4e455fe6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.217845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a65fa-e43d-4ddd-a966-bc0d4e455fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.218123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a65fa-e43d-4ddd-a966-bc0d4e455fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.236925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-982a65fa-e43d-4ddd-a966-bc0d4e455fe6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:51.238423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-982a65fa-e43d-4ddd-a966-bc0d4e455fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:51.303122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1138/2275] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:51.313377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:51.316295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:51.328918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:51.378160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75405342-290a-4a7f-b948-b8d1eea9a31a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:51.382540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:51.383162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:51.383507 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:51.383763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:51.394342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:51.395818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:51.406627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1138/2276] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:22:55.145197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:55.145781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:55.145781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:55.202511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] MFA Rules not processed for user `931dcabba0214e3daa878f31cd1706cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:55.203745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:55.340784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1139/2277] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:22:55.345001 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:55.347261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:55.389026 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ebf88-6366-402c-a711-4652d39aa11f service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:55.406281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:55.407076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:55.407435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:55.407766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:55.408649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:55.411126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:55.514827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1139/2278] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:22:55 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:55.516334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:55.553018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303053c-886a-433a-b5f7-9a892af14fcd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:55.677907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:22:55.696250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:55.697013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:55.697924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:55.697924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:55.698236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:55.700532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:55.746800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1140/2279] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:22:55 2022] POST /identity/v3/users => generated 299 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:22:55.753776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:55.780688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751f7e-6fe4-4c96-9b67-d0f83133a68f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:55.786242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:55.787098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:55.787387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:55.787716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:55.788374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:55.790349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:55.804714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1140/2280] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:55.809707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:55.823049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab21c29-fdcf-4b13-81cc-121f1283fc30 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:55.844661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:55.845352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:55.845663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:55.845936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] PATH_INFO: `/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a/users/680770df475b425ab83d5745b723f9af/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:55.868908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64ad5f5fb7144f6a33afcd998b95f2a, user_id=680770df475b425ab83d5745b723f9af, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:55.872154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:55.892358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1141/2281] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:55 2022] PUT /identity/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a/users/680770df475b425ab83d5745b723f9af/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:22:55.893707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:55.905998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e486479-d149-417e-be98-ea6c373a4d3d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:56.041705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:56.042483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:56.042885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:56.043226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:56.043964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:56.047240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ac8db-465d-41ed-a7ac-3c8888f825a2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:56.068981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1141/2282] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:22:56.072831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:22:56.095274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c36c5d-c392-4231-8ed7-186acb3232ba admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:22:56.102819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:22:56.103591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:56.103960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:56.104412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] PATH_INFO: `/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a/users/680770df475b425ab83d5745b723f9af/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:56.110643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64ad5f5fb7144f6a33afcd998b95f2a, user_id=680770df475b425ab83d5745b723f9af, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:22:56.110643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ce85-b7fb-468f-bd67-a36ca0349956 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:22:56.132944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1142/2283] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:22:56 2022] PUT /identity/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a/users/680770df475b425ab83d5745b723f9af/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:22:57.151142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:22:57.151670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:22:57.151754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:22:57.194782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] MFA Rules not processed for user `1eb664209056410d890d1b2b8bfa0155`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:22:57.201866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:22:57.345743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1142/2284] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:22:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:02.168520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:02.169210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:02.169210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:02.227934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] MFA Rules not processed for user `ef7f53d57f3544e5a25e1beeddab9af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:02.230024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:02.441372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1143/2285] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:02.446537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:02.506119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:02.625311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9bd2de-13a3-4bcc-9596-1e79e0901bc4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:02.631455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:02.632670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:02.633214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:02.633754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:02.634667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:02.642683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:02.711699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1143/2286] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:23:02 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:23:02.712648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:02.745816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349a600-5819-421d-b3f3-f82ba26b4d62 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:03.011924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:03.012575 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:03.012879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:03.013112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:03.013829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:03.015831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:03.078745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1144/2287] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:23:02 2022] POST /identity/v3/users => generated 292 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:23:03.083012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:03.102934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9589b7-4d28-4b91-bbd5-5692516170c3 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:03.115289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:03.116178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:03.116530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:03.116974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:03.117696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:03.123255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:03.156991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1144/2288] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:23:03.159945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:03.189716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62c32-92c0-457d-a01c-f66ccfa3a117 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:03.219542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:03.220516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:03.220894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:03.221268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] PATH_INFO: `/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898/users/6b54cd14640e4901832ae64528003e77/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:03.254513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:03.297498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb812d2de6d4b0eb01f96c8e6854898, user_id=6b54cd14640e4901832ae64528003e77, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:03.313254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:03.390911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1145/2289] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:23:03 2022] PUT /identity/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898/users/6b54cd14640e4901832ae64528003e77/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:23:03.395927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:03.440404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccb15c-5119-4253-bea0-fe1c9a814f06 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:03.662890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:03.664304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:03.665588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:03.668792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:03.669829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:03.675390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2caeec-e93c-4c15-80ef-e9a12d9d0383 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:03.707647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:03.708399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1145/2290] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:23:03.731299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9754e1b-f061-452e-9c7c-5fd37b6c8434 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:03.752800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:03.754391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:03.755108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:03.755826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] PATH_INFO: `/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898/users/6b54cd14640e4901832ae64528003e77/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:03.778054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb812d2de6d4b0eb01f96c8e6854898, user_id=6b54cd14640e4901832ae64528003e77, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:03.785022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:03.804300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1146/2291] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:23:03 2022] PUT /identity/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898/users/6b54cd14640e4901832ae64528003e77/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:23:07.318599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4942e-b9a6-41ef-8716-1508d7b929ca None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:07.319036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4942e-b9a6-41ef-8716-1508d7b929ca None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:07.319152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4942e-b9a6-41ef-8716-1508d7b929ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:07.352493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7ff4942e-b9a6-41ef-8716-1508d7b929ca None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:07.356191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7ff4942e-b9a6-41ef-8716-1508d7b929ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:07.523366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1146/2292] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:23:07.548505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:07.551222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:07.975435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0b1a2-0078-41a8-90bb-56a14c26630d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:08.006329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:08.007328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:08.007788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:08.008248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:08.044748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:08.048710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:08.089613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1147/2293] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:08.904748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f98de-6789-4db4-9ecb-2f104990d97f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:08.905276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f98de-6789-4db4-9ecb-2f104990d97f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:08.905358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f98de-6789-4db4-9ecb-2f104990d97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:08.943392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d09f98de-6789-4db4-9ecb-2f104990d97f None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:08.944567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d09f98de-6789-4db4-9ecb-2f104990d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:09.023864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:09.122373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1147/2294] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:23:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:09.137785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:09.140100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:09.345944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed05d64-b1a1-4180-8ab6-4f72ed91b1a0 service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:09.355556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:09.356214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:09.356495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:09.356769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:09.380030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:09.381703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:09.405894 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1148/2295] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:23:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:23:13.383487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e2-f788-4f58-81f3-38637e29a263 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:13.384724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e2-f788-4f58-81f3-38637e29a263 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:13.385425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3d3e2-f788-4f58-81f3-38637e29a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:13.455899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-50e3d3e2-f788-4f58-81f3-38637e29a263 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:13.460963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-50e3d3e2-f788-4f58-81f3-38637e29a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:13.495339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1148/2296] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:13.642724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:13.661147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aac9c8-f75a-4102-8d56-99fdd32c0f82 service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:13.686138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:13.687730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:13.688581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:13.689383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:13.727528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:13.731178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:13.792933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1149/2297] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:16.204136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954ecc-8a3b-4dbd-9270-b060f9d10a00 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:16.206710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954ecc-8a3b-4dbd-9270-b060f9d10a00 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:16.207532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52954ecc-8a3b-4dbd-9270-b060f9d10a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:16.379691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-52954ecc-8a3b-4dbd-9270-b060f9d10a00 None None] MFA Rules not processed for user `680770df475b425ab83d5745b723f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:16.381872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-52954ecc-8a3b-4dbd-9270-b060f9d10a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:16.654891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1149/2298] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:16.664293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:16.666141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:16.907250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:16.974261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3802d8f-5e8d-428d-82f5-1a93ccfdcef6 service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:16.989359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:16.990261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:16.990911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:16.991249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:17.207557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:17.210221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:17.226240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1150/2299] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:17.559689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba561b-3ff8-43e6-9e63-79c0cdaf3abd None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:17.560723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba561b-3ff8-43e6-9e63-79c0cdaf3abd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:17.561682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba561b-3ff8-43e6-9e63-79c0cdaf3abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:17.639950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-36ba561b-3ff8-43e6-9e63-79c0cdaf3abd None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:17.641879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-36ba561b-3ff8-43e6-9e63-79c0cdaf3abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:17.670526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1150/2300] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:17.748083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:17.787565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c78509-1bad-42b7-85aa-341d83714a20 service glance] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:17.824685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:17.825340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:17.829014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:17.829372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:17.863393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e6-ea32-4410-a0bb-7de52b8b0a42 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:17.863990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e6-ea32-4410-a0bb-7de52b8b0a42 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:17.865795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975862e6-ea32-4410-a0bb-7de52b8b0a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:17.869917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:17.872672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:17.896240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1151/2301] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:23:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:23:18.052971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-975862e6-ea32-4410-a0bb-7de52b8b0a42 None None] MFA Rules not processed for user `6b54cd14640e4901832ae64528003e77`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:18.064206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-975862e6-ea32-4410-a0bb-7de52b8b0a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:18.515371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1151/2302] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 654 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:18.955826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:18.983596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28156e-8c9a-454f-b4fc-a8f594cc8ca3 service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:19.005062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:19.007032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:19.007619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:19.008098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:19.088832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:19.091375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:19.120929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1152/2303] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:19.528984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e023dc-691d-4570-a639-28a0b0da1c93 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:19.530459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e023dc-691d-4570-a639-28a0b0da1c93 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:19.531151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e023dc-691d-4570-a639-28a0b0da1c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:19.595780 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e1e023dc-691d-4570-a639-28a0b0da1c93 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:19.606324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e1e023dc-691d-4570-a639-28a0b0da1c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:19.648576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1152/2304] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:19.674319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:19.676086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:19.718243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2443055-c887-45c2-8ef3-928355f645ee service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:19.737367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:19.738407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:19.738890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:19.739359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:19.762345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:19.767900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a20db-9259-4a5b-8a7a-200023f84117 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:19.807054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1153/2305] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:23.434581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:23.435743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:23.436270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:23.500016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] MFA Rules not processed for user `ef7f53d57f3544e5a25e1beeddab9af4`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:23.504932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:23.526945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1153/2306] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:23:23.867608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:23.868452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:23.869245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:23.963172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:23.975849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:24.008809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1154/2307] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:24.043283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:24.103070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581c0e-4fbb-4612-a249-d0308732d6fb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:24.116015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:24.116935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:24.117431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:24.117869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:24.138770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:24.147074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e1f2c-5eb2-4189-bcab-a629318f4bc0 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:24.232806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1154/2308] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:24.317632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:24.317632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:24.376283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11218f6-d1ef-46d7-9329-394830ef0e69 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:24.413117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:24.413842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:24.414124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:24.414394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] PATH_INFO: `/v3/users/67155053792c4941a92a06f9a92cab7b` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:24.415615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67155053792c4941a92a06f9a92cab7b)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:24.417716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:24.597436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67155053792c4941a92a06f9a92cab7b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:24.607035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:24.722345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67155053792c4941a92a06f9a92cab7b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:24.722345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67155053792c4941a92a06f9a92cab7b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:24.747244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67155053792c4941a92a06f9a92cab7b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:24.747953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67155053792c4941a92a06f9a92cab7b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:24.918729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:24.919371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:24.919619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:24.921826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1155/2309] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:23:24 2022] DELETE /identity/v3/users/67155053792c4941a92a06f9a92cab7b => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:23:25.004982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:25.065722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:25.071486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:25.359199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1155/2310] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:25.370723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:25.374614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:25.707429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ab9bb-b518-45b3-b36b-eae2f420c3b7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:25.711828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:25.712661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:25.713095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:25.716161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:25.735794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:25.737911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5b1dc-fc2b-4a0d-a2da-f7a35800c062 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:25.770217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1156/2311] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:26.868462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:26.871313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:26.942928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcbafbb-5e1d-40c3-bb73-63e263ffce9c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:26.954996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:26.956071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:26.956642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:26.957133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] PATH_INFO: `/v3/projects/874b95fbcdbe47e1a8f1f330d792128d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:26.958871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=874b95fbcdbe47e1a8f1f330d792128d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:26.963806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:27.078476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '874b95fbcdbe47e1a8f1f330d792128d', 'request_id': 'req-0668c015-8a59-40fc-8b1b-022968f082fa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:27.093569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '874b95fbcdbe47e1a8f1f330d792128d', 'request_id': 'req-0668c015-8a59-40fc-8b1b-022968f082fa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:27.107173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '874b95fbcdbe47e1a8f1f330d792128d', 'request_id': 'req-0668c015-8a59-40fc-8b1b-022968f082fa'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:27.142105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] The token cache is being invalidate because project 874b95fbcdbe47e1a8f1f330d792128d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:23:27.149995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:27.152294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:23:27.159349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1156/2312] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:23:26 2022] DELETE /identity/v3/projects/874b95fbcdbe47e1a8f1f330d792128d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:23:28.716174 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98de7-3cdd-4b95-9a67-3b2b849404b3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:28.716995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98de7-3cdd-4b95-9a67-3b2b849404b3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:28.716995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b98de7-3cdd-4b95-9a67-3b2b849404b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:28.784065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a2b98de7-3cdd-4b95-9a67-3b2b849404b3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:28.787402 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a2b98de7-3cdd-4b95-9a67-3b2b849404b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:29.090704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1157/2313] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:29.120293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:29.121997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:29.407449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668c015-8a59-40fc-8b1b-022968f082fa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:29.414274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:29.415307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:29.415742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:29.416372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:29.427802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:29.429830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:29.458250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1157/2314] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:23:33.296309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441b0-ea0e-453a-b100-ad96ac759bd9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:33.296927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441b0-ea0e-453a-b100-ad96ac759bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:33.297223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19441b0-ea0e-453a-b100-ad96ac759bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:33.395329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c19441b0-ea0e-453a-b100-ad96ac759bd9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:33.398370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c19441b0-ea0e-453a-b100-ad96ac759bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:33.419500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1158/2315] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:33.447253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:33.473174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a674c2-4a95-47c9-adc4-dc3900356a88 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:33.501751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:33.503595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:33.507377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:33.508227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:33.663379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:33.681002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b137b38-bdd8-4413-a808-e40e36fd1430 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:33.708206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1158/2316] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:23:37.263584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-8590-419b-96f2-3723889255ae None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:37.264161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-8590-419b-96f2-3723889255ae None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:37.264317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770f524-8590-419b-96f2-3723889255ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:37.316960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f770f524-8590-419b-96f2-3723889255ae None None] MFA Rules not processed for user `931dcabba0214e3daa878f31cd1706cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:37.319119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f770f524-8590-419b-96f2-3723889255ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:37.400895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1159/2317] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:23:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:42.394640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:42.395237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:42.395628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:42.398318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1159/2318] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:23:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:23:42.408114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227de041-6cf6-44e7-a3f0-f4a0701971df None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:42.408746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227de041-6cf6-44e7-a3f0-f4a0701971df None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:42.409217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227de041-6cf6-44e7-a3f0-f4a0701971df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:42.434806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-227de041-6cf6-44e7-a3f0-f4a0701971df None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:42.437829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-227de041-6cf6-44e7-a3f0-f4a0701971df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:42.453338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1160/2319] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:23:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:42.470421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:42.473040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:42.485194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:42.651535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597852-8ae5-4c84-bdcf-e1ab48d24643 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:42.659787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:42.660550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:42.660918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:42.661191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:42.725172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:42.730285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea709b-56f0-48dc-b033-0fe41dd6fe0b service glance] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:42.770607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1160/2320] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:42.955364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:42.956831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:42.958597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:42.961326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1161/2321] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:23:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:23:42.972250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bed74-fec6-4861-99d6-e072f6adaa5d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:42.972725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bed74-fec6-4861-99d6-e072f6adaa5d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:42.973235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bed74-fec6-4861-99d6-e072f6adaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:43.022201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d30bed74-fec6-4861-99d6-e072f6adaa5d None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:43.024581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d30bed74-fec6-4861-99d6-e072f6adaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:43.181192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1161/2322] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:23:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:43.199181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:43.201755 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:43.217677 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:43.228764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37d11d-6665-4461-9fea-915e43492b8e None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:43.236261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:43.237696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:43.238655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:43.239439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:43.252965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:43.256366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98e70a-f69b-4198-bad9-90ea26f2fc52 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:43.272971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1162/2323] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:43.428075 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6602df-3b61-4e2b-abd1-f33fd99d7deb None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:43.428718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6602df-3b61-4e2b-abd1-f33fd99d7deb None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:43.429014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6602df-3b61-4e2b-abd1-f33fd99d7deb None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:43.431973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1162/2324] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:23:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:23:43.441980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c68-eff6-4541-b2ee-ee1d033dae1a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:43.442812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c68-eff6-4541-b2ee-ee1d033dae1a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:43.448846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b63c68-eff6-4541-b2ee-ee1d033dae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:43.490979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c9b63c68-eff6-4541-b2ee-ee1d033dae1a None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:43.493450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c9b63c68-eff6-4541-b2ee-ee1d033dae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:43.508651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1163/2325] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:23:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:43.521318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6602df-3b61-4e2b-abd1-f33fd99d7deb None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:43.543148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6602df-3b61-4e2b-abd1-f33fd99d7deb None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:43.547856 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:43.548818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:43.549353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:43.549779 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:43.567356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:43.570239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:43.587908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1163/2326] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:23:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:23:49.174296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32fd19-04ed-4203-9779-c0619c59724b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:49.175978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32fd19-04ed-4203-9779-c0619c59724b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:49.176582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32fd19-04ed-4203-9779-c0619c59724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:49.219507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2e32fd19-04ed-4203-9779-c0619c59724b None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:23:49.222111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2e32fd19-04ed-4203-9779-c0619c59724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:49.387943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1164/2327] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:23:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:23:49.408565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:23:49.411029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:23:49.548097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee618f0-c665-41d4-96cb-499a4c2c3f64 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:23:49.555272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:23:49.556251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:23:49.556537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:23:49.556808 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:23:49.567485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:23:49.569140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:23:49.579645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1164/2328] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:23:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:23:59.372514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=33 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:23:59.575699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=86 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:00.389184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39238-5fe9-4385-a03e-1ed67ec17247 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:00.390339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39238-5fe9-4385-a03e-1ed67ec17247 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:00.391680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39238-5fe9-4385-a03e-1ed67ec17247 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:00.395053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1165/2329] 10.222.0.61 () {54 vars in 961 bytes} [Sat Aug 27 02:24:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:24:00.405211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:00.405838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:00.406244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:00.406498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:00.409327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:00.442835 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] MFA Rules not processed for user `a86ad86f6b9d40b0be18eb23c4e8c08b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:00.445478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:00.566068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5338bd-5a84-4bea-a24d-1b7cea30630e service swift] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:00.576793 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:00.578151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:00.578770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:00.579551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:00.583327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:00.604184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1166/2330] 10.222.0.61 () {58 vars in 1058 bytes} [Sat Aug 27 02:24:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:24:00.615421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:00.618819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9582f-fe65-4cec-b123-5556fabf19c6 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:00.620163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:00.636008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305470f-6ad5-4885-9e7f-daeda5787420 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:00.640340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1165/2331] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:24:00.647006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:00.648023 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:00.648641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:00.649229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:00.666562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:00.670371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:00.697049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1167/2332] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:24:07.670044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622604d-8d06-42d2-a70b-7d742c94ee95 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:07.671122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622604d-8d06-42d2-a70b-7d742c94ee95 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:07.671611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0622604d-8d06-42d2-a70b-7d742c94ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:07.705523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0622604d-8d06-42d2-a70b-7d742c94ee95 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:07.707046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0622604d-8d06-42d2-a70b-7d742c94ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:07.716946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1166/2333] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:24:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:24:07.732722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:07.746843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f9845-0140-4e4e-bbd1-ad0c2bc12e81 service placement] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:07.762983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:07.764025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:07.764557 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:07.764782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:07.783013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:07.784897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:07.796121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1168/2334] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 02:24:09.786479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87098d-3cf7-42fb-9643-94750032fb57 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:09.787516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87098d-3cf7-42fb-9643-94750032fb57 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:09.788008 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87098d-3cf7-42fb-9643-94750032fb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:09.867970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7c87098d-3cf7-42fb-9643-94750032fb57 None None] MFA Rules not processed for user `2f931e726872474dae2b7b6fbb0eb644`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:09.869625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7c87098d-3cf7-42fb-9643-94750032fb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:10.034837 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1167/2335] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:24:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 27 02:24:17.791918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=41 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:20.022847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=60 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:30.628928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:30.631366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:30.652727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791e5f-05d2-4972-b6bc-927fea9630ae service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:30.660452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:30.661667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:30.662159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:30.662700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:30.664664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:30.775100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:30.776316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:30.776749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:30.784097 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:30.787777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:30.802679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1169/2336] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:24:30.805386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:30.806687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:30.839099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1168/2337] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:24:30.853905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:30.875767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127570-11aa-466f-83db-9b1b3f89069d service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:30.892374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:30.893340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:30.893672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:30.893932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:30.913994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:30.916255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e30074-fd0c-4358-9acf-fac08b841aa1 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:30.956525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1170/2338] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 02:24:33.127289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:33.140433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c546a77-08c2-4626-845f-b80eeebe20d1 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:33.147043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:33.147680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:33.148048 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:33.148360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:33.150415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:33.402765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:33.406435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2337ba-853a-4f72-af49-55c4a37abf85 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:33.426954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1169/2339] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:24:39.383676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:39.385594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:39.386478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:39.421698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] MFA Rules not processed for user `4a6f819365574091ae344f14e47f487f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:39.423869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:39.554724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1171/2340] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:24:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:24:43.417031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=33 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:24:45.953596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7811a-c832-4253-9f17-9864872e231e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:45.954537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7811a-c832-4253-9f17-9864872e231e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:45.954537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7811a-c832-4253-9f17-9864872e231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:45.978052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-84d7811a-c832-4253-9f17-9864872e231e None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:45.979349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-84d7811a-c832-4253-9f17-9864872e231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:45.989033 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1170/2341] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:24:46.021311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:46.034361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701c03b-29a5-49ef-ae4e-3e88ac322b55 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:46.040027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:46.040724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:46.041062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:46.041427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:46.051132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:46.052720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:46.065792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1172/2342] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:24:51.334656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b771-149e-4a8f-855b-5a4c3c138391 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:51.334656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b771-149e-4a8f-855b-5a4c3c138391 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:51.335173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526b771-149e-4a8f-855b-5a4c3c138391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:51.371496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b526b771-149e-4a8f-855b-5a4c3c138391 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:51.373117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b526b771-149e-4a8f-855b-5a4c3c138391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:51.383184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1171/2343] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:24:51.405869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:51.426958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57ddfc-744a-44f0-b7c4-56948ca0fc26 service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:51.437725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:51.438746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:51.439483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:51.440009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:51.454095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:51.456268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616c027-ed78-4a37-8cdd-03a9ba18c2b9 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:51.473293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1173/2344] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:24:54.556422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:54.557289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:54.557289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:54.581951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] MFA Rules not processed for user `1eb664209056410d890d1b2b8bfa0155`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:54.584176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:54.651317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1172/2345] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:24:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:24:56.512259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715df-8c34-4001-96db-506cd784f19a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:56.512761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715df-8c34-4001-96db-506cd784f19a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:56.513222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6715df-8c34-4001-96db-506cd784f19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:56.541935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2e6715df-8c34-4001-96db-506cd784f19a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:24:56.543167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2e6715df-8c34-4001-96db-506cd784f19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:56.553068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1174/2346] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:24:56.578677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:24:56.580461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:24:56.598774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d15a6-075e-47ff-aaa8-6186f554e745 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:24:56.605998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:24:56.606855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:24:56.607183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:24:56.607496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:24:56.619018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:24:56.620876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:24:56.632471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1173/2347] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:24:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:01.793549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a23d-d760-4cbd-a0b6-c513bfc5499a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:01.794191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a23d-d760-4cbd-a0b6-c513bfc5499a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:01.794437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a23d-d760-4cbd-a0b6-c513bfc5499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:01.807802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=77 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:01.824406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9fc9a23d-d760-4cbd-a0b6-c513bfc5499a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:25:01.825872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9fc9a23d-d760-4cbd-a0b6-c513bfc5499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:01.835746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1175/2348] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:25:01.870473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:01.894214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a11b93b-a674-443a-8868-515bdf251bd1 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:01.903732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:01.904707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:01.905188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:01.905735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:01.920216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:01.922521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:01.934107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1174/2349] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:07.105306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6062-86f2-45cc-9c3c-5e25b5277e04 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:07.105948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6062-86f2-45cc-9c3c-5e25b5277e04 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:07.105948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d6062-86f2-45cc-9c3c-5e25b5277e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:07.127352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d20d6062-86f2-45cc-9c3c-5e25b5277e04 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:25:07.128714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d20d6062-86f2-45cc-9c3c-5e25b5277e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:07.138233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1176/2350] 10.222.0.78 () {58 vars in 1016 bytes} [Sat Aug 27 02:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:25:07.176255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:07.189961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249d723-eb19-482c-9303-0dc06de31ac0 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:07.198022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:07.198568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:07.198855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:07.199126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:07.209670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:07.211505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:07.229310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1175/2351] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:17.122011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:17.222681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=49 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:32.014065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:32.014705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:32.014705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:32.038856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] MFA Rules not processed for user `cd08f3b52004476b9eb532c7c68ab679`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:25:32.040071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:32.117172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1177/2352] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:25:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:25:40.152163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:40.153925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:40.169806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341e944-8e49-4eb8-954c-137ffd4cf025 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:40.176305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:40.177034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:40.177282 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:40.177873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] PATH_INFO: `/v3/users/2f931e726872474dae2b7b6fbb0eb644` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:40.179293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f931e726872474dae2b7b6fbb0eb644)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:40.181616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:40.246536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f931e726872474dae2b7b6fbb0eb644'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.260165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f931e726872474dae2b7b6fbb0eb644'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.279699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f931e726872474dae2b7b6fbb0eb644'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.280986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f931e726872474dae2b7b6fbb0eb644'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.289789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f931e726872474dae2b7b6fbb0eb644'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.300725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1176/2353] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:25:40 2022] DELETE /identity/v3/users/2f931e726872474dae2b7b6fbb0eb644 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:25:40.622505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:40.642454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b02c-bb3f-4dc9-92ad-91a99934724f None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:40.744274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:40.745429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:40.745934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:40.746393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] PATH_INFO: `/v3/projects/ac7bf59244bc487b84c7dbf9aa7314d2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:40.748371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7bf59244bc487b84c7dbf9aa7314d2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:40.752492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:40.841454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'request_id': 'req-908e4b2d-f30e-4111-8c2c-7904eefe46e4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.851353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'request_id': 'req-908e4b2d-f30e-4111-8c2c-7904eefe46e4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.863569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7bf59244bc487b84c7dbf9aa7314d2', 'request_id': 'req-908e4b2d-f30e-4111-8c2c-7904eefe46e4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.885028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] The token cache is being invalidate because project ac7bf59244bc487b84c7dbf9aa7314d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:25:40.885564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.886609 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:25:40.889306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1178/2354] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:25:40 2022] DELETE /identity/v3/projects/ac7bf59244bc487b84c7dbf9aa7314d2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:25:41.128137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:41.130468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:41.218911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d186d-7633-49c0-9802-0a72c48b6c36 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:41.318272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:41.318945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:41.319225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:41.319496 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:41.322040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:41.413911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:41.478543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:41.481577 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f10fb-d187-47cd-a4b9-7841bec52abd service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:41.502239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1177/2355] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:44.111089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:44.112540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:44.126120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4b2d-f30e-4111-8c2c-7904eefe46e4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:44.130330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:44.131133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:44.131504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:44.131871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:44.133957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:44.150605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:44.152198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:44.165267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1179/2356] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:47.807463 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:47.808366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:47.808366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:47.829974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] MFA Rules not processed for user `22fbea2c71674b239e6d8fba6518e962`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:25:47.831217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:47.894091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1178/2357] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:25:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:25:54.040373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:54.042133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:54.070986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:25:54.106163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f5ac40-20c0-485a-bde4-f00abc1ac36e service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:54.110706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:54.111514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:54.111652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:54.111831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:54.114297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:54.178846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:54.180342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:54.190109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1180/2358] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:54 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:55.368601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:55.370149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:55.383399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f861ae1-180e-419b-9d35-03c9bf9532db None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:55.389813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:55.389813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:55.389813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:55.389813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:55.393053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:55.398886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:25:55.400500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:55.434230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ce7f-fe01-4dc0-b34e-81b23bcfa0b4 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:25:55.443221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:25:55.444436 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:25:55.444710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:25:55.444984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:25:55.446781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:25:55.469027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:55.470791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64a850-d360-4c62-b744-e99c3532943e service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:55.481160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1179/2359] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:25:55.519608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:25:55.521876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:25:55.537787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1181/2360] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:25:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:00.147376 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:00.148155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:00.148155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:00.167458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] MFA Rules not processed for user `4a6f819365574091ae344f14e47f487f`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:00.168692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:00.177935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1180/2361] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:00.503686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:00.513334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e03d8-6fe4-43db-a9f4-a237a8614acd service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:00.517705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:00.518344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:00.518618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:00.518886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:00.521189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:00.532502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:00.533975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:00.542912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1182/2362] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:00.882734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:00.884250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:00.961858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaca19-d192-4860-984c-dfec85c5dd1c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:00.967366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:00.968054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:00.968333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:00.968597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:00.970352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:00.979928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:00.982772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:00.984536 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:00.995611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1181/2363] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:06.648274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:06.679548 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de0e42-380c-4960-9249-32bf617e592e service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:06.695001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:06.695629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:06.695902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:06.696363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:06.699375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:06.725003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:06.726782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:06.739434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1183/2364] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:10.991088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:16.323388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:16.336151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e23ef-2420-406f-a599-719e401db375 service placement] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:16.341966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:16.342576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:16.342858 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:16.343134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:16.344935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:16.357906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:16.359508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:16.371010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1182/2365] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:16.734266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=78 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:23.761769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:23.772107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79aeaab-4061-4efc-bdee-822986539622 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:23.776861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:23.777512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:23.777797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:23.778088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:23.780148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:23.846345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:23.847791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:23.857650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1184/2366] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:26.366194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=6 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:28.066816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.068506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:28.082930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a665-a583-4b48-88b3-973a4d91d33b service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.087537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.088187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.088464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.088738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] PATH_INFO: `/v3/users/1eb664209056410d890d1b2b8bfa0155` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.089917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb664209056410d890d1b2b8bfa0155)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.091853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.142117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb664209056410d890d1b2b8bfa0155'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.150668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb664209056410d890d1b2b8bfa0155'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.162616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb664209056410d890d1b2b8bfa0155'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.163318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb664209056410d890d1b2b8bfa0155'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.170952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-38ab3311-7dcf-41bd-806d-36c3510611fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb664209056410d890d1b2b8bfa0155'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.177224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1183/2367] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:28 2022] DELETE /identity/v3/users/1eb664209056410d890d1b2b8bfa0155 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:28.355710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.366327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7af082-151c-47b8-bd81-4a862f385262 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.426893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.427521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.427796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.428062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] PATH_INFO: `/v3/projects/67209b74f2fa4ae7ad9762d141378a5d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.429214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67209b74f2fa4ae7ad9762d141378a5d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.431188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.478129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67209b74f2fa4ae7ad9762d141378a5d', 'request_id': 'req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.483799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67209b74f2fa4ae7ad9762d141378a5d', 'request_id': 'req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.490119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67209b74f2fa4ae7ad9762d141378a5d', 'request_id': 'req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.504018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] The token cache is being invalidate because project 67209b74f2fa4ae7ad9762d141378a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:28.504348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.505019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d7c66c41-b9a7-4e87-ad3f-44e4d3f1425e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:28.506580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1185/2368] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:28 2022] DELETE /identity/v3/projects/67209b74f2fa4ae7ad9762d141378a5d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:28.511769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.512066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.512348 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.533085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:28.534327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:28.599111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1184/2369] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:28.607182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.607467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.607745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.630518 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:28.631745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:28.640906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1186/2370] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:28.645420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.655943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87705d-f127-4e5a-b3d1-2c8641c3d620 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.668317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.669058 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.669359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.669842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.670548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:26:28.670897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.672628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.685814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1185/2371] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:26:28.690659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.700601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2757c-7038-4ba0-afea-fd64f334124d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.705685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.706293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.706704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.707063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.707955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.710689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.731001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:28.745334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1187/2372] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:28 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:28.749783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.760089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990b0dc-145c-40a4-811f-636db2655152 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.819767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.820379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.820659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.820934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.821593 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.823540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.831750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:28.849866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1186/2373] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:28 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:28.851011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.861818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b6d24-e39e-4339-bf76-93e830f01ac1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.867093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.867694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.867957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.868224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.868858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.870504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.881236 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1188/2374] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:26:28.885650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.896628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed68b0-ff00-4315-9453-e18c35292907 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.901655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.902268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.902548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.902821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.903618 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.905226 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a9fd4-2d90-4e9a-a307-f89435c166c6 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.918628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1187/2375] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:28.923210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:28.935533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8801f3-8b87-443c-88b8-d89804808669 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:28.943091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:28.943976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:28.944293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:28.944632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] PATH_INFO: `/v3/projects/93a9b3af642741029900bef04a4ea40c/users/193f615602b14f15b2fb561f09ca2d37/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:28.967485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a9b3af642741029900bef04a4ea40c, user_id=193f615602b14f15b2fb561f09ca2d37, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:28.970503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:28.993667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1189/2376] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:28 2022] PUT /identity/v3/projects/93a9b3af642741029900bef04a4ea40c/users/193f615602b14f15b2fb561f09ca2d37/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:29.005413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:29.005765 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:29.006177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:29.038273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] MFA Rules not processed for user `193f615602b14f15b2fb561f09ca2d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:29.039753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:29.112370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1188/2377] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:29.125363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:29.127458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:29.219902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436893f7-2bf5-4919-ba8f-ca84e7972b70 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:29.226349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:29.227233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:29.227593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:29.227954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:29.236770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:29.238481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:29.257611 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1190/2378] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:29.687431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:29.700438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b62652-23ff-4928-9269-ec273d12b80b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:29.706191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:29.706787 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:29.707060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:29.707333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:29.709105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:29.771509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:29.773036 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67096a51-b667-4ffa-a1c1-6545bff596ce service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:29.782387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1189/2379] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:31.996133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:32.063487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879cef6-f5b3-4c72-a4eb-203fa004a2cc service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:32.068394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:32.069027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.069302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.069605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] PATH_INFO: `/v3/users/193f615602b14f15b2fb561f09ca2d37` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.070771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=193f615602b14f15b2fb561f09ca2d37)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:32.072743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:32.123726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '193f615602b14f15b2fb561f09ca2d37'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.124979 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:32.139851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '193f615602b14f15b2fb561f09ca2d37'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.140594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '193f615602b14f15b2fb561f09ca2d37'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.148571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '193f615602b14f15b2fb561f09ca2d37'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.149296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '193f615602b14f15b2fb561f09ca2d37'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.162381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1191/2380] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:31 2022] DELETE /identity/v3/users/193f615602b14f15b2fb561f09ca2d37 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:32.166923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.167433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.167530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.187452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:32.188693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:32.255312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1190/2381] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:32.265354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:32.266856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:32.330774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c6be2-8842-435f-909f-c02b06fb0c96 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:32.334754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:32.335371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.335650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.336742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.346383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:32.347872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a55d6-788b-46fd-84fb-c9cf3c7abdfc service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:32.357857 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1192/2382] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:32.676096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:32.678114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:32.697300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c378b4d1-3feb-40e7-ba33-0fd78b53cd50 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:32.706689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:32.708174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.709063 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.709736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] PATH_INFO: `/v3/projects/93a9b3af642741029900bef04a4ea40c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.711107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a9b3af642741029900bef04a4ea40c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:32.713289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:32.715693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:32.783387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a9b3af642741029900bef04a4ea40c', 'request_id': 'req-d407797c-0a4a-41fd-afa8-8da2e2676236'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.806775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a9b3af642741029900bef04a4ea40c', 'request_id': 'req-d407797c-0a4a-41fd-afa8-8da2e2676236'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.818386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a9b3af642741029900bef04a4ea40c', 'request_id': 'req-d407797c-0a4a-41fd-afa8-8da2e2676236'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.831785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] The token cache is being invalidate because project 93a9b3af642741029900bef04a4ea40c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:32.832371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.833946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d407797c-0a4a-41fd-afa8-8da2e2676236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:32.839267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1191/2383] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:32 2022] DELETE /identity/v3/projects/93a9b3af642741029900bef04a4ea40c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:32.841280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.841743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.842062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.870003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:32.871858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:32.950685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1193/2384] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:32.960533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:32.961610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:32.961957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:32.985341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:32.986713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:32.996904 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1192/2385] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:33.001478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.012913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3316c8-55fd-4f07-b0ca-c6e27a9d99b9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.017816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.018427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.018751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.018977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.019737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:26:33.020043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.021683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.033872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1194/2386] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:26:33.038302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.047832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b56f2-bd4a-47b9-bcb8-af6ce4747442 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.053138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.053795 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.054073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.054350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.055069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.056900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.089073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1193/2387] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:33.093725 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.105450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533b3a9-2c4e-4fda-8980-41d3da5c638f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.160244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:33.168244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.168864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.169140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.169451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.170432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.172596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.198498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1195/2388] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:33.200204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.211710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c812cd-9eed-4c11-9aa0-84ff1ba59ee5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.217174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.217863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.218120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.218392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.219047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.220672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.231553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1194/2389] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:33.236300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.247490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773fbba3-cef7-4f81-bf66-6387da741ab4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.254292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.254921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.255195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.255476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.256107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.257871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a842b5-7873-4bde-9f4e-2bff99fe4efb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.271323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1196/2390] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:33.275754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.288878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787dc02-53f3-4ed5-b1fe-c31a67551ba9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.295167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.296101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.296467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.296886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] PATH_INFO: `/v3/projects/7d9e03cb3eaa432bae21c0c193f8fb5e/users/3e5cfe52e5d4464b9ca8bd87e2b33176/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.318186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9e03cb3eaa432bae21c0c193f8fb5e, user_id=3e5cfe52e5d4464b9ca8bd87e2b33176, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.321221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.338175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1195/2391] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:33 2022] PUT /identity/v3/projects/7d9e03cb3eaa432bae21c0c193f8fb5e/users/3e5cfe52e5d4464b9ca8bd87e2b33176/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:33.348984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.349269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.349587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.380175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] MFA Rules not processed for user `3e5cfe52e5d4464b9ca8bd87e2b33176`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:33.381469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:33.455649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1197/2392] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:33.460754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.533285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1ffb5-62fd-44e8-a6fb-42143b537b6f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.539309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.539931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.540219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.540797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.541543 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.543564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.582195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1196/2393] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:33.584054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.598170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e7ada-851f-4d89-983e-1ba2164d4964 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.671088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.672573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.672573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.672573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.674036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.674888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.698526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1198/2394] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/users => generated 296 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:26:33.702796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.714195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92de7c7-ec9a-4baa-8910-9af9e2c2f170 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.718987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.719599 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.719879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.720149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.720801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.722442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.728097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:33.735486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1197/2395] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:33.740936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.751371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a377504-9cda-4e50-94e2-2c81713f8ad9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.762895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.763482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.763756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.764022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] PATH_INFO: `/v3/projects/1312845529064c86a392f6c7b04254bb/users/d8f3c15bbed14608b951a9893e2b6947/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.780914 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312845529064c86a392f6c7b04254bb, user_id=d8f3c15bbed14608b951a9893e2b6947, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.783647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.798566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1199/2396] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:33 2022] PUT /identity/v3/projects/1312845529064c86a392f6c7b04254bb/users/d8f3c15bbed14608b951a9893e2b6947/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:33.803074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.815646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c024516-5739-4a8f-8b84-0773a0f6ed3c admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.874485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.875099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.875375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.875642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.876275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.877920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843d6d6-26aa-4916-b0bd-cb94f0f13261 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.888794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1198/2397] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:33.893775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:33.905732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be074d93-4689-4092-9a05-c323f78f06e5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:33.910910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:33.911585 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.912002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.912281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] PATH_INFO: `/v3/projects/1312845529064c86a392f6c7b04254bb/users/d8f3c15bbed14608b951a9893e2b6947/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.916471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1312845529064c86a392f6c7b04254bb, user_id=d8f3c15bbed14608b951a9893e2b6947, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:33.920902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f76eac-7943-41a2-ae91-265357276761 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:33.932468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1200/2398] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:33 2022] PUT /identity/v3/projects/1312845529064c86a392f6c7b04254bb/users/d8f3c15bbed14608b951a9893e2b6947/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:33.944796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:33.945062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:33.945331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:33.987975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] MFA Rules not processed for user `d8f3c15bbed14608b951a9893e2b6947`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:33.990010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:33.999752 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:34.000123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:34.000591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:34.022641 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:34.023865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:34.034607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:34.079022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1199/2399] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:34.091638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1201/2400] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:26:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:34.093895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:34.095459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:34.167067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:34.168718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:34.172328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e54eea-26c1-4c76-89b8-4609005a2db2 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:34.177325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:34.178079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:34.179114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:34.179461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:34.224276 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:34.249940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:34.251603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:34.257302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9f338-9f35-4e97-bd38-007a3b0faed6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:34.262143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1200/2401] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:34.263239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:34.264026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:34.264375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:34.264962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:34.274587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:34.276210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:34.285743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1202/2402] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:26:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 27 02:26:35.683601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:35.685148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:35.697620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2515c7f-3ac6-4da2-a8e8-edc4c58a4e28 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:35.701788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:35.702402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:35.702681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:35.702946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:35.713717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:35.715504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fca4cb-474d-43f2-b1e1-3ceaf5b82edd service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:35.726917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1201/2403] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:39.686072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:39.785674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6796a54-0aa5-4827-b36f-8fafd44da346 service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:39.791559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:39.792238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:39.792647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:39.792776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] PATH_INFO: `/v3/users/3e5cfe52e5d4464b9ca8bd87e2b33176` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:39.794062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e5cfe52e5d4464b9ca8bd87e2b33176)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:39.796001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:39.859470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e5cfe52e5d4464b9ca8bd87e2b33176'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:39.866028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:39.881904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e5cfe52e5d4464b9ca8bd87e2b33176'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:39.882678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e5cfe52e5d4464b9ca8bd87e2b33176'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:39.896508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e5cfe52e5d4464b9ca8bd87e2b33176'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:39.897127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e5cfe52e5d4464b9ca8bd87e2b33176'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:39.912150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1203/2404] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:39 2022] DELETE /identity/v3/users/3e5cfe52e5d4464b9ca8bd87e2b33176 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:39.922240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:39.922804 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:39.923007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:39.942449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:39.943584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:40.010771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1202/2405] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:40.021560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:40.023091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:40.091764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e09def-951b-4823-bdeb-1213bded9b97 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:40.095995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:40.096829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:40.097121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:40.097416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:40.109021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:40.110569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:40.122017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1204/2406] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:40.413252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:40.415174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:40.431874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc704f4-5cc2-4936-a54d-5f75c7aad9f7 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:40.437873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:40.442562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:40.442842 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:40.443131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] PATH_INFO: `/v3/projects/7d9e03cb3eaa432bae21c0c193f8fb5e` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:40.448299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9e03cb3eaa432bae21c0c193f8fb5e)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:40.450570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:40.508377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9e03cb3eaa432bae21c0c193f8fb5e', 'request_id': 'req-b189638f-8aa1-4db3-88f9-896493129b2f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.519245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9e03cb3eaa432bae21c0c193f8fb5e', 'request_id': 'req-b189638f-8aa1-4db3-88f9-896493129b2f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.529607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9e03cb3eaa432bae21c0c193f8fb5e', 'request_id': 'req-b189638f-8aa1-4db3-88f9-896493129b2f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.543742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] The token cache is being invalidate because project 7d9e03cb3eaa432bae21c0c193f8fb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:40.544086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.544730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.546364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1203/2407] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:40 2022] DELETE /identity/v3/projects/7d9e03cb3eaa432bae21c0c193f8fb5e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:40.550439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:40.562534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4029615-0065-4436-9c17-fab397f20717 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:40.631743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:40.632391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:40.633906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:40.634196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] PATH_INFO: `/v3/users/d8f3c15bbed14608b951a9893e2b6947` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:40.635415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f3c15bbed14608b951a9893e2b6947)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:40.638840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:40.695972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f3c15bbed14608b951a9893e2b6947'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.709089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f3c15bbed14608b951a9893e2b6947'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.709846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f3c15bbed14608b951a9893e2b6947'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.720310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f3c15bbed14608b951a9893e2b6947'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.721067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a8de9ab8-e98f-4c13-a520-d133866d32cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f3c15bbed14608b951a9893e2b6947'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:40.725574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:40.743634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1205/2408] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:40 2022] DELETE /identity/v3/users/d8f3c15bbed14608b951a9893e2b6947 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:26:41.077038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.079294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:41.097150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189638f-8aa1-4db3-88f9-896493129b2f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.168809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:41.185210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.185897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.186181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.186461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] PATH_INFO: `/v3/projects/1312845529064c86a392f6c7b04254bb` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.187897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1312845529064c86a392f6c7b04254bb)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.190049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.254192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1312845529064c86a392f6c7b04254bb', 'request_id': 'req-358526cd-29ea-4c03-b360-f4630df476bd'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:41.263052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1312845529064c86a392f6c7b04254bb', 'request_id': 'req-358526cd-29ea-4c03-b360-f4630df476bd'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:41.270101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1312845529064c86a392f6c7b04254bb', 'request_id': 'req-358526cd-29ea-4c03-b360-f4630df476bd'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:41.283631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] The token cache is being invalidate because project 1312845529064c86a392f6c7b04254bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:41.283923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:41.284568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-358526cd-29ea-4c03-b360-f4630df476bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:41.286420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1204/2409] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:41 2022] DELETE /identity/v3/projects/1312845529064c86a392f6c7b04254bb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:26:41.291107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.291326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.291595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.312469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:41.316359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:41.417505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1206/2410] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:41.428171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.428171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.428171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.465636 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:41.467275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:41.486742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1205/2411] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:26:41.490450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.506516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ed4c3-0a1f-4803-8646-68dffe9a37c3 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.512339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.513093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.513606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.513880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.514880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:26:41.515180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.516839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.534155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1207/2412] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:26:41.535379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.545625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff7a7f3-8319-4e7b-965b-4bc178597f40 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.550777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.551413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.551693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.551973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.552630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.555252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.590426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1206/2413] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:41.591869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.602702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2cf2c-0e36-42f3-817a-82b2b5315ac5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.664016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.664628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.664905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.665164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.665867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.667773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.693949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1208/2414] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:41.698103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.709332 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f3a7b-d182-44e3-9cd8-23d2e79e6f1d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.714916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.715700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.715956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.716265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.716997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.718677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.729783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1207/2415] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:41.734088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.746270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a0370-840a-4a66-a467-829f6141cce5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.751484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.752791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.753124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.753423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.754184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.755823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6beab-c571-4fc9-9ca6-70635d832084 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.769445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1209/2416] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:41.772740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:41.784219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8aeaaa-2820-4dbf-9396-c173ba01d718 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:41.789164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:41.789890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.790168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.790444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] PATH_INFO: `/v3/projects/2e1153c516d64deb9b02b44874c78cbf/users/5102db62c8c24f00b0d7e92e511c1a7d/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.813503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1153c516d64deb9b02b44874c78cbf, user_id=5102db62c8c24f00b0d7e92e511c1a7d, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:41.816211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:41.849595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1208/2417] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:41 2022] PUT /identity/v3/projects/2e1153c516d64deb9b02b44874c78cbf/users/5102db62c8c24f00b0d7e92e511c1a7d/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:41.850897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:41.851181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:41.851452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:41.889152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] MFA Rules not processed for user `5102db62c8c24f00b0d7e92e511c1a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:41.891596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:41.954445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:41.983884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1210/2418] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:41.988814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.103090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b734eb9-fad3-45fc-b94f-32bfdd5a7e61 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.109594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.110087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.110642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.111121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.112080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.114422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.147905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:42.156998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1209/2419] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:41 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:42.161298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.192345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a3145-ddd7-4172-ab00-edde0d67273f None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.293582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.293582 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.294049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.294245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.294905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.296861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.338488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1211/2420] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:42 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:26:42.340582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.354472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c287e58-26ab-4fed-8d65-68358aa11520 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.359393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.360698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.360698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.360698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.361326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.363031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.380797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1210/2421] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:42.382104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.393929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe1771-6a6d-4d67-94bb-f95af50536f1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.399423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.400175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.400521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.400862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] PATH_INFO: `/v3/projects/f996099b6f4c44d18e38a51fc206ca1d/users/d6f6432fe2d149ec844a0b75322d15a3/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.417954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f996099b6f4c44d18e38a51fc206ca1d, user_id=d6f6432fe2d149ec844a0b75322d15a3, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.420795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.436749 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1212/2422] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:42 2022] PUT /identity/v3/projects/f996099b6f4c44d18e38a51fc206ca1d/users/d6f6432fe2d149ec844a0b75322d15a3/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:42.440758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.451338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ff4a5-5792-4db8-b144-6fe4637fd9da admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.505139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.506930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:42.524638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.525167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.532152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.532152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.532152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.532152 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.539591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1211/2423] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:42.543709 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.554766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829298d-1ad3-4b52-81bc-817449185cb1 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.561952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.562647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.562921 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.563244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] PATH_INFO: `/v3/projects/f996099b6f4c44d18e38a51fc206ca1d/users/d6f6432fe2d149ec844a0b75322d15a3/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.565174 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f996099b6f4c44d18e38a51fc206ca1d, user_id=d6f6432fe2d149ec844a0b75322d15a3, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.568043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207e01-b324-42be-93c1-dff36ba76af8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.575567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b13cec-e8d2-4747-a4d9-419c5597241f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.581344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.582248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.582503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.582811 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] PATH_INFO: `/v3/users/931dcabba0214e3daa878f31cd1706cc` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.584106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931dcabba0214e3daa878f31cd1706cc)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.584293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1212/2424] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:42 2022] PUT /identity/v3/projects/f996099b6f4c44d18e38a51fc206ca1d/users/d6f6432fe2d149ec844a0b75322d15a3/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:42.586579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.596303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.596303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.596639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.627530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] MFA Rules not processed for user `d6f6432fe2d149ec844a0b75322d15a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:42.628818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:42.640401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931dcabba0214e3daa878f31cd1706cc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:42.646286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:42.655960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931dcabba0214e3daa878f31cd1706cc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:42.667008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931dcabba0214e3daa878f31cd1706cc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:42.676744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931dcabba0214e3daa878f31cd1706cc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:42.677644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931dcabba0214e3daa878f31cd1706cc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:42.690639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1213/2425] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:42 2022] DELETE /identity/v3/users/931dcabba0214e3daa878f31cd1706cc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:26:42.706784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1213/2426] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:26:42.718606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.720004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:42.782399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d0278-bd47-4dfd-8609-284346b555a2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.786270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.786879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.787152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.787406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.849801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:42.851267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:42.861594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1214/2427] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:26:42.879117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.881070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:42.964751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:42.968858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:42.972181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9117f-0ece-4554-823c-7ee8989f319d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.978671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fe1c-b064-447f-a4ca-837a5890311e service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:42.982532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:42.983166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:42.983431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:42.983710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:42.985615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:43.047634 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:43.048220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:43.048483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:43.048783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] PATH_INFO: `/v3/projects/fe4f956d4d27437c830871f6634a3018` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:43.050092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4f956d4d27437c830871f6634a3018)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:43.052120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:43.056267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:43.057809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:43.068559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1215/2428] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:26:43.101176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4f956d4d27437c830871f6634a3018', 'request_id': 'req-37b3a3d3-aceb-4514-b868-e21a5a0cd498'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.109987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4f956d4d27437c830871f6634a3018', 'request_id': 'req-37b3a3d3-aceb-4514-b868-e21a5a0cd498'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.118395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4f956d4d27437c830871f6634a3018', 'request_id': 'req-37b3a3d3-aceb-4514-b868-e21a5a0cd498'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.130684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] The token cache is being invalidate because project fe4f956d4d27437c830871f6634a3018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:43.131037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.131764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.133262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1214/2429] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:42 2022] DELETE /identity/v3/projects/fe4f956d4d27437c830871f6634a3018 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:43.137980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:43.150278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ebb65-9a4e-4c43-8ff3-d8b6b0876226 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:43.170116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:43.217519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:43.218484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:43.218919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:43.219346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] PATH_INFO: `/v3/users/680770df475b425ab83d5745b723f9af` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:43.220977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=680770df475b425ab83d5745b723f9af)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:43.223574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:43.278020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680770df475b425ab83d5745b723f9af'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.292021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680770df475b425ab83d5745b723f9af'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.292735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680770df475b425ab83d5745b723f9af'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.300057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680770df475b425ab83d5745b723f9af'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.300693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680770df475b425ab83d5745b723f9af'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.314831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1216/2430] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:43 2022] DELETE /identity/v3/users/680770df475b425ab83d5745b723f9af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:43.531554 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:43.533423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:43.565456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3a3d3-aceb-4514-b868-e21a5a0cd498 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:43.625380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:43.626065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:43.626342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:43.626616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] PATH_INFO: `/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:43.627905 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64ad5f5fb7144f6a33afcd998b95f2a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:43.629911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:43.673029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:43.684052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64ad5f5fb7144f6a33afcd998b95f2a', 'request_id': 'req-5d250ed4-63e0-42e3-809e-f60ff7678154'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.694834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64ad5f5fb7144f6a33afcd998b95f2a', 'request_id': 'req-5d250ed4-63e0-42e3-809e-f60ff7678154'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.702983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64ad5f5fb7144f6a33afcd998b95f2a', 'request_id': 'req-5d250ed4-63e0-42e3-809e-f60ff7678154'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.715801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] The token cache is being invalidate because project a64ad5f5fb7144f6a33afcd998b95f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:43.716062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.716812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5d250ed4-63e0-42e3-809e-f60ff7678154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:43.718880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1215/2431] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:43 2022] DELETE /identity/v3/projects/a64ad5f5fb7144f6a33afcd998b95f2a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:48.152296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:48.153838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:48.167482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddfb5f-0d3b-4842-96d6-3682c02daad6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:48.227962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:48.228619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:48.228897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:48.229173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] PATH_INFO: `/v3/users/5102db62c8c24f00b0d7e92e511c1a7d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:48.230480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5102db62c8c24f00b0d7e92e511c1a7d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:48.232478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:48.282950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:48.291640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5102db62c8c24f00b0d7e92e511c1a7d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.310996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5102db62c8c24f00b0d7e92e511c1a7d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.311754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5102db62c8c24f00b0d7e92e511c1a7d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.323026 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5102db62c8c24f00b0d7e92e511c1a7d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.323956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5102db62c8c24f00b0d7e92e511c1a7d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.338660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1217/2432] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:48 2022] DELETE /identity/v3/users/5102db62c8c24f00b0d7e92e511c1a7d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:48.343792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:48.344358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:48.344358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:48.368459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:48.370460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:48.437305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1216/2433] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:48.447528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:48.448966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:48.512353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad930-73a9-42a4-b108-d98b84c1db23 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:48.516560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:48.517170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:48.517488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:48.517746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:48.527594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:48.529036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:48.539060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1218/2434] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:48.835118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:48.836647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:48.848756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f416c7da-2a40-4d26-bdc1-0a0dff5ac45a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:48.854882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:48.855658 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:48.856198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:48.856586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] PATH_INFO: `/v3/projects/2e1153c516d64deb9b02b44874c78cbf` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:48.857833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1153c516d64deb9b02b44874c78cbf)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:48.862874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:48.919374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1153c516d64deb9b02b44874c78cbf', 'request_id': 'req-a861121f-44ad-45bd-8603-c6de6b0fe889'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.927902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1153c516d64deb9b02b44874c78cbf', 'request_id': 'req-a861121f-44ad-45bd-8603-c6de6b0fe889'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.934514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1153c516d64deb9b02b44874c78cbf', 'request_id': 'req-a861121f-44ad-45bd-8603-c6de6b0fe889'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.944760 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] The token cache is being invalidate because project 2e1153c516d64deb9b02b44874c78cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:48.945039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.945834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:48.947426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1217/2435] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:48 2022] DELETE /identity/v3/projects/2e1153c516d64deb9b02b44874c78cbf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:48.951948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:48.962692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe485f75-507d-43ec-b9a4-3558e8e84aad service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:49.023878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:49.024503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.024775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.025048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] PATH_INFO: `/v3/users/d6f6432fe2d149ec844a0b75322d15a3` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.026427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f6432fe2d149ec844a0b75322d15a3)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:49.028418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:49.082255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f6432fe2d149ec844a0b75322d15a3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.094014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:49.095381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f6432fe2d149ec844a0b75322d15a3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.096414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f6432fe2d149ec844a0b75322d15a3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.104827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f6432fe2d149ec844a0b75322d15a3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.105711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f98a8a8e-6d2d-4d81-a3d1-951e605d35e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f6432fe2d149ec844a0b75322d15a3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.119286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1219/2436] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:48 2022] DELETE /identity/v3/users/d6f6432fe2d149ec844a0b75322d15a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:49.440817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:49.442549 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:49.461836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861121f-44ad-45bd-8603-c6de6b0fe889 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:49.520097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:49.538954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:49.539739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.540107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.540418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] PATH_INFO: `/v3/projects/f996099b6f4c44d18e38a51fc206ca1d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.542666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f996099b6f4c44d18e38a51fc206ca1d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:49.545849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:49.638587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f996099b6f4c44d18e38a51fc206ca1d', 'request_id': 'req-65dcef6d-1d97-4cf2-845d-2731c9aebb40'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.650428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f996099b6f4c44d18e38a51fc206ca1d', 'request_id': 'req-65dcef6d-1d97-4cf2-845d-2731c9aebb40'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.657417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f996099b6f4c44d18e38a51fc206ca1d', 'request_id': 'req-65dcef6d-1d97-4cf2-845d-2731c9aebb40'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.669502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] The token cache is being invalidate because project f996099b6f4c44d18e38a51fc206ca1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:49.669859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.670537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-65dcef6d-1d97-4cf2-845d-2731c9aebb40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:49.672242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1218/2437] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:49 2022] DELETE /identity/v3/projects/f996099b6f4c44d18e38a51fc206ca1d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:26:49.678332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.678860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.678860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.699294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:49.700663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:49.768668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1220/2438] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:49.779422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.779861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.780262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.801822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:49.803094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:49.818909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1219/2439] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:49.823850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:49.835071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b819f69-a9f6-457b-b4dd-3325694a6458 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:49.842819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:49.843628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.843905 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.844244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.844824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:26:49.845111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:49.846844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:49.859965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1221/2440] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:26:49.865596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:49.879096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa28178-468a-4464-99d5-cfd9453dbf24 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:49.885892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:49.886767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:49.887200 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:49.887467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:49.888218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:49.891635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:49.924619 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1220/2441] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:49 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:49.929121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:49.941130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1a778-678a-4062-9750-ba2aa0b227e1 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.004868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.005471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.005748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.006058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.006651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.008570 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.031912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1222/2442] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:49 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:50.036305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.046959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1374bd-b8ff-44cd-91f8-94da707369ba admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.051721 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.052331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.052610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.053347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.054046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.055668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.066907 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1221/2443] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:26:50.072192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.085683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d14f3-7cbd-4fed-9a5f-518ef7ddbed8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.091778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.092379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.092655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.092959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.093880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.095726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0c85c-fdf6-45f1-a4ed-e01affd1ff5d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.108408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1223/2444] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:50.113928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.125195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbfbf-65f8-47cc-a727-f7d13c6fb656 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.131724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.132422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.132700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.132968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] PATH_INFO: `/v3/projects/c70b02f052294966bb013133a0dc0db6/users/8ecde9eca2df49a3bc667bcd52ab0792/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.150409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70b02f052294966bb013133a0dc0db6, user_id=8ecde9eca2df49a3bc667bcd52ab0792, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.153190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.168037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1222/2445] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:50 2022] PUT /identity/v3/projects/c70b02f052294966bb013133a0dc0db6/users/8ecde9eca2df49a3bc667bcd52ab0792/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:50.179984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.180269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.180544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.212924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] MFA Rules not processed for user `8ecde9eca2df49a3bc667bcd52ab0792`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:50.214187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:50.251410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.289130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1224/2446] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:50.304476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.306441 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:50.371354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4025fb-76d4-4354-bbfb-e0fde3a8faac admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.375668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.376275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.376548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.376814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.386884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.388602 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c44d71-f3b9-4411-b3dc-f072678c4377 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.399337 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1223/2447] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:50.429693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.499115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d62e2a-9bdf-4f36-b94a-86b1deb206ce None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.505474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.506261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.506597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.506929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] PATH_INFO: `/v3/users/8ecde9eca2df49a3bc667bcd52ab0792` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.508399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecde9eca2df49a3bc667bcd52ab0792)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.510600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.569934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecde9eca2df49a3bc667bcd52ab0792'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:50.592390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecde9eca2df49a3bc667bcd52ab0792'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:50.593580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecde9eca2df49a3bc667bcd52ab0792'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:50.603983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecde9eca2df49a3bc667bcd52ab0792'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:50.604624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecde9eca2df49a3bc667bcd52ab0792'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:50.618665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1225/2448] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:26:50 2022] DELETE /identity/v3/users/8ecde9eca2df49a3bc667bcd52ab0792 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:50.623710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.624298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.624298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.645237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:50.646851 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:50.658286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.715821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1224/2449] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:50.728587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:50.730511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:50.817799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436bdad-4705-43cb-8348-e10e833c6e4b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:50.826512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:50.827499 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:50.827958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:50.828406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:50.841524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:50.842996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2252300-42ac-4653-a28f-0daf3fbc5cc6 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:50.847577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:50.855475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1226/2450] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:51.200896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.202406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:51.219790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b3174-74ed-44a1-9583-e2551c8ce437 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.227170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.227833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.228113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.228465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] PATH_INFO: `/v3/projects/c70b02f052294966bb013133a0dc0db6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.229700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70b02f052294966bb013133a0dc0db6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.231955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.293728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70b02f052294966bb013133a0dc0db6', 'request_id': 'req-d871e3fe-0be5-4713-bfa6-99e762276bc7'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:51.303897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70b02f052294966bb013133a0dc0db6', 'request_id': 'req-d871e3fe-0be5-4713-bfa6-99e762276bc7'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:51.317422 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70b02f052294966bb013133a0dc0db6', 'request_id': 'req-d871e3fe-0be5-4713-bfa6-99e762276bc7'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:51.335065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] The token cache is being invalidate because project c70b02f052294966bb013133a0dc0db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:26:51.335374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:51.336448 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d871e3fe-0be5-4713-bfa6-99e762276bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:26:51.341032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1225/2451] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:26:51 2022] DELETE /identity/v3/projects/c70b02f052294966bb013133a0dc0db6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:51.348384 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.348701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.349275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.375908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:51.377241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:51.448045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1227/2452] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:26:51.456662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.456943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.457220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.481723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:51.483257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:51.492782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1226/2453] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:51.498765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.515286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d26930-24e6-4d7a-93a4-7ecc8e700742 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.524523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.525703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.525998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.526278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.527029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:26:51.527341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.529206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.544550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1228/2454] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:26:51.550992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.564571 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ebf4-7073-4e2d-8c9d-edf59ee4d1bf None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.571305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.572118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.572409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.572684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.573362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.575436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.609567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1227/2455] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:26:51 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:51.614542 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.625801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6d29d-2f32-4442-8d54-47b64f5f8594 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.695867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.696498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.696785 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.697048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.697738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.699790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.725207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1229/2456] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:26:51 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:26:51.729533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.741364 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b403744-99af-4da7-b079-9707ec5eb531 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.747277 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.747925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.748202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.748467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.749183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.750952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.763832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1228/2457] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:51.769224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.780990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824ef57-7f48-4b62-bcd0-ed490d7eabef admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.787126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.787765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.788042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.788309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.788969 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.790674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c0618-3038-4cf3-ab31-3e64a6ee7420 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.803200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1230/2458] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:26:51.807472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:51.819202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2796f734-9eca-4b25-9021-f8c4b2bd1bc9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:51.825172 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:51.825939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.826202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.826473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] PATH_INFO: `/v3/projects/b4375a438eb646288f6a734eb753a39b/users/d7e4ed60f6b243d4a331a0b8f8b277c1/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.844094 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4375a438eb646288f6a734eb753a39b, user_id=d7e4ed60f6b243d4a331a0b8f8b277c1, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:51.846950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:51.864778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1229/2459] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:26:51 2022] PUT /identity/v3/projects/b4375a438eb646288f6a734eb753a39b/users/d7e4ed60f6b243d4a331a0b8f8b277c1/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:26:51.875469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:51.875804 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:51.876083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:51.907494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] MFA Rules not processed for user `d7e4ed60f6b243d4a331a0b8f8b277c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:51.908726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:51.973958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:51.986862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1231/2460] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:26:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:52.000653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:52.002711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:52.046086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:26:52.064966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd44bf6-b368-464e-be5b-67ab986289a9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:52.068964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:52.069623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:52.069890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:52.070171 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:52.079093 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:52.080624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d2b58-c4b0-42cd-8c96-2ad1aafe8f11 service glance] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:52.090644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1230/2461] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:53.258071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:53.259708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:53.352574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aaee1-bd6b-48c0-819d-c9b0677a5072 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:53.358321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:53.358986 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:53.359264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:53.359534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:53.361296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:53.425520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:53.427295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:53.437321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1232/2462] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:26:57.085306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:57.085924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:57.086025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:57.106755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:26:57.107975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:57.174775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1231/2463] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:26:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:26:57.187766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:57.189605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:57.266930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a6b8e-359f-4b4b-9cf1-4999c7f6719f service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:57.273064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:57.273649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:57.273929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:57.274196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:57.283831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:57.287623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:57.295342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1233/2464] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:26:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:26:57.477353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:26:57.515906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887c747-8c01-4f76-8951-b14c08d2ebd0 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:26:57.539272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:26:57.539829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:26:57.540117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:26:57.540426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:26:57.549838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:26:57.574389 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:26:57.577695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bb478-532a-40d6-9349-174ddc29d684 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:26:57.611462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1232/2465] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:26:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:07.291470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:07.594509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=41 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:08.245858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:08.247373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:08.323605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870bdb9-70d3-4e2a-a9e9-276df551a73e service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:08.327664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:08.328302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.328587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.328886 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.330817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:08.342223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:08.343706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca436fa-c5f6-4488-b4c2-5dccb3608da9 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:08.353224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1234/2466] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:08.503180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.503468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.503966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] PATH_INFO: `/` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.505340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1233/2467] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:27:08.512509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a06-017a-4458-a9b0-2482f0030b1b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.512897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a06-017a-4458-a9b0-2482f0030b1b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.513233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab2a06-017a-4458-a9b0-2482f0030b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.536041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0cab2a06-017a-4458-a9b0-2482f0030b1b None None] MFA Rules not processed for user `5340cd7471884cc2b5a584d7e435d447`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:08.537593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0cab2a06-017a-4458-a9b0-2482f0030b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:08.545143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1235/2468] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:08.558598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:08.560644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:08.575232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a537c-237e-472c-89c8-310e5d115650 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:08.579568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:08.580184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.580459 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.580762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.589646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:08.591122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483ec7b-a11d-4e3d-8ada-e7d0e03b91b1 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:08.600547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1234/2469] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:08.686927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4e27-02bb-4b1e-b9ef-8450cc79ce76 None None] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.687211 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4e27-02bb-4b1e-b9ef-8450cc79ce76 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.687484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc4e27-02bb-4b1e-b9ef-8450cc79ce76 None None] PATH_INFO: `/` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.688867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1236/2470] 10.222.0.61 () {54 vars in 921 bytes} [Sat Aug 27 02:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 27 02:27:08.694201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.694485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.694753 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.714353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] MFA Rules not processed for user `9ddf36f45acc45fe99073dec8c3ee497`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:08.715791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:08.725414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1235/2471] 10.222.0.61 () {58 vars in 1018 bytes} [Sat Aug 27 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:08.736332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4e27-02bb-4b1e-b9ef-8450cc79ce76 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:08.748167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc4e27-02bb-4b1e-b9ef-8450cc79ce76 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:08.752124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:08.752700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.753043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.753342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.764104 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:08.765912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c282897-4c92-4c36-8e37-82af8ce6d15b service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:08.776789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1237/2472] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:08.887116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:08.974660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6bd9b-6ae7-4831-98ae-8fbe74584642 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:08.980197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:08.980876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:08.981157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:08.981546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] PATH_INFO: `/v3/users/d7e4ed60f6b243d4a331a0b8f8b277c1` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:08.982867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e4ed60f6b243d4a331a0b8f8b277c1)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:08.984906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:09.051335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e4ed60f6b243d4a331a0b8f8b277c1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.062752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e4ed60f6b243d4a331a0b8f8b277c1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.083847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e4ed60f6b243d4a331a0b8f8b277c1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.084861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e4ed60f6b243d4a331a0b8f8b277c1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.099325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e4ed60f6b243d4a331a0b8f8b277c1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.109012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1236/2473] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:08 2022] DELETE /identity/v3/users/d7e4ed60f6b243d4a331a0b8f8b277c1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:09.113874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.114159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.114430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.134850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:09.136113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:09.201738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1238/2474] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:09.211937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:09.213388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:09.280519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398b16-0951-4984-9dfa-0105f0dea8fc admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:09.284338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:09.285320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.285633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.285972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.299735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:09.302241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eaf1d9-8051-493d-be0b-97d18ea84d46 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:09.319410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1237/2475] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:09.644179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:09.646357 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:09.668964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb29077-0375-46be-a2ab-d057b1089d23 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:09.676135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:09.677765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.677765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.678610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] PATH_INFO: `/v3/projects/b4375a438eb646288f6a734eb753a39b` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.680900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4375a438eb646288f6a734eb753a39b)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:09.683472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:09.736852 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4375a438eb646288f6a734eb753a39b', 'request_id': 'req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.742782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4375a438eb646288f6a734eb753a39b', 'request_id': 'req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.750540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4375a438eb646288f6a734eb753a39b', 'request_id': 'req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.766851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] The token cache is being invalidate because project b4375a438eb646288f6a734eb753a39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:09.767182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.767798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-86d4ca0f-c89a-4cca-baa5-a7802b3cc6be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:09.769569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1239/2476] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:09 2022] DELETE /identity/v3/projects/b4375a438eb646288f6a734eb753a39b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:09.774451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.774937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.775047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.782918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:09.798023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:09.799477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:09.862916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1238/2477] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:09.871673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.872024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.872332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.887810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:09.894404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:09.896297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:09.904993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1240/2478] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:09.910087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:09.921104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48030-4f57-44c4-bb04-ed18a2f1c198 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:09.926118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:09.926726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.927004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.927294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.928024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:09.928354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:09.930217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:09.943243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1239/2479] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:09.953267 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:09.963514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a679cf-323b-4317-b00a-736f7d8168cc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:09.969809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:09.970443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:09.970716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:09.971001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:09.971661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:09.973672 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.009419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1241/2480] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:09 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:10.013928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:10.025241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a797105-00b2-4db0-aaed-b3158d8b7356 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:10.093345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:10.094078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.094410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.094749 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.095473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:10.097678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.121214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1240/2481] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:10 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:10.125842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:10.137166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f7620-07fe-4570-8733-1fe8f2c972ce admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:10.142393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:10.142998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.143269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.143605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.144252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:10.145899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.157511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1242/2482] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:10.161961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:10.175930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee5cd1-7369-41f9-bca8-1bd4b7eafaa9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:10.182515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:10.183263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.183587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.183834 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.184613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:10.186578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3d3c4-f9e9-48bf-b1f3-4a598375b584 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.199040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1241/2483] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:10.203764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:10.215172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7777a-9e5a-4258-8a57-a7294fe4bad7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:10.220873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:10.221709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.222044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.222277 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] PATH_INFO: `/v3/projects/6f71fdd8329444ff98d5e3d74aba43dd/users/24ef14e2cab04cb9ab8eb9eeba040049/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.238566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f71fdd8329444ff98d5e3d74aba43dd, user_id=24ef14e2cab04cb9ab8eb9eeba040049, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:10.241248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.256107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1243/2484] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:10 2022] PUT /identity/v3/projects/6f71fdd8329444ff98d5e3d74aba43dd/users/24ef14e2cab04cb9ab8eb9eeba040049/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:10.267687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96825e-fc7f-4e97-ab79-8385d4b792ec None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.268024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96825e-fc7f-4e97-ab79-8385d4b792ec None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.268297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96825e-fc7f-4e97-ab79-8385d4b792ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.301242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3c96825e-fc7f-4e97-ab79-8385d4b792ec None None] MFA Rules not processed for user `24ef14e2cab04cb9ab8eb9eeba040049`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:10.302592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3c96825e-fc7f-4e97-ab79-8385d4b792ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:10.374238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:10.380742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1242/2485] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:10.392593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:10.394485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:10.456160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26edba-8875-483a-a0f4-dc1dc8648129 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:10.460310 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:10.460966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:10.461213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:10.461592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:10.479167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:10.482168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:10.495837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1244/2486] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:19.499831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:19.500450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:19.500902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:19.527054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:19.528375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:19.633766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1243/2487] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:27:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:19.640471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:19.642592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:19.752692 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df7515-bd84-4866-89d5-97c69f9db439 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:19.758485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:19.759106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:19.759378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:19.759642 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:19.781096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:19.781096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:19.796032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1245/2488] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:27:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:21.209468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:21.211461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:21.348049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dce5-1b62-4196-85b1-2939ce33f2ef None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:21.352723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:21.353598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:21.354034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:21.354462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:21.356576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:21.475985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:21.479273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0eb4d6-328e-42e6-aebd-57f6971e7d92 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:21.486510 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:21.500504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1244/2489] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:21.501926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e63fc-8bef-4b7d-b875-616f40b9aa2b service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:21.507457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:21.508492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:21.508769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:21.509053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] PATH_INFO: `/v3/users/24ef14e2cab04cb9ab8eb9eeba040049` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:21.510347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24ef14e2cab04cb9ab8eb9eeba040049)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:21.517533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:21.595380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:21.631005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24ef14e2cab04cb9ab8eb9eeba040049'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:21.661620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24ef14e2cab04cb9ab8eb9eeba040049'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:21.663217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24ef14e2cab04cb9ab8eb9eeba040049'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:21.678468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24ef14e2cab04cb9ab8eb9eeba040049'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:21.679562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24ef14e2cab04cb9ab8eb9eeba040049'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:21.714452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1246/2490] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:21 2022] DELETE /identity/v3/users/24ef14e2cab04cb9ab8eb9eeba040049 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:21.719693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:21.719988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:21.720264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:21.756884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:21.759427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:21.918982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:21.933710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1245/2491] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:21.947226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:21.951389 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:22.114279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d72e-e460-4817-b5fc-f3b68a345494 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:22.122112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:22.123874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:22.125547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:22.126098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:22.140740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:22.142258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:22.168946 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1247/2492] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:22.683217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:22.684684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:22.709068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b206d-ce55-43fd-8227-dc48f6efb365 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:22.726051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:22.726761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:22.726991 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:22.727264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] PATH_INFO: `/v3/projects/6f71fdd8329444ff98d5e3d74aba43dd` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:22.730250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f71fdd8329444ff98d5e3d74aba43dd)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:22.737487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:22.830073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f71fdd8329444ff98d5e3d74aba43dd', 'request_id': 'req-10718ca9-005d-4cd5-b16e-31104d817d6d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:22.839331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f71fdd8329444ff98d5e3d74aba43dd', 'request_id': 'req-10718ca9-005d-4cd5-b16e-31104d817d6d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:22.851107 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f71fdd8329444ff98d5e3d74aba43dd', 'request_id': 'req-10718ca9-005d-4cd5-b16e-31104d817d6d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:22.879060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] The token cache is being invalidate because project 6f71fdd8329444ff98d5e3d74aba43dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:22.880470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:22.882763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:22.888671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1246/2493] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:22 2022] DELETE /identity/v3/projects/6f71fdd8329444ff98d5e3d74aba43dd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:24.901185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:24.913598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f16429f-550e-4bb3-9662-455c6a2ee5c2 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:25.024957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:25.026281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:25.026729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:25.027111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:25.032118 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:25.099322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:25.100803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:25.107372 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:25.118192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1248/2494] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:27.620297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:27.623423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:27.705045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:27.709878 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:27.730758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b73d61-b262-4622-8eda-44d2f65291ed service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:27.767474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:27.768739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:27.769336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:27.769913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] PATH_INFO: `/v3/users/22fbea2c71674b239e6d8fba6518e962` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:27.777332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22fbea2c71674b239e6d8fba6518e962)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:27.779746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:27.900227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10718ca9-005d-4cd5-b16e-31104d817d6d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:27.910078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:27.910728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:27.911135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:27.911468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:27.914487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:27.929884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22fbea2c71674b239e6d8fba6518e962'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:27.955797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:27.961647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:27.984115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22fbea2c71674b239e6d8fba6518e962'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:27.984871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22fbea2c71674b239e6d8fba6518e962'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:27.995234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22fbea2c71674b239e6d8fba6518e962'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:27.995832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-e49a1104-0377-4c37-b6a7-4721ecb46604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22fbea2c71674b239e6d8fba6518e962'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.031044 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1247/2496] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:27:28.036466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1249/2496] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:27 2022] DELETE /identity/v3/users/22fbea2c71674b239e6d8fba6518e962 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:27:28.773146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:28.791351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca417d30-666e-46d7-ba38-397957f020ee service placement] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:28.887194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:28.887999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:28.888390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:28.888761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] PATH_INFO: `/v3/projects/782d9d02db5c49fda33321f2914a7f31` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:28.890418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782d9d02db5c49fda33321f2914a7f31)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:28.892464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:28.902752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:28.953377 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782d9d02db5c49fda33321f2914a7f31', 'request_id': 'req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.965097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782d9d02db5c49fda33321f2914a7f31', 'request_id': 'req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.972831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782d9d02db5c49fda33321f2914a7f31', 'request_id': 'req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.987468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] The token cache is being invalidate because project 782d9d02db5c49fda33321f2914a7f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:28.987863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.988462 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-8aff3e0e-0a8f-4d67-a191-2c226ace8d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:28.990270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1248/2497] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:28 2022] DELETE /identity/v3/projects/782d9d02db5c49fda33321f2914a7f31 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:28.995214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:28.997165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:28.998306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.023724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:29.025089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:29.098735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1250/2498] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:29.106687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.107097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.107548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.130960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:29.132347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:29.142140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1249/2499] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:29.146312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.156617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a759f-d69f-4191-bd00-4caa6433a7ac None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.161440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.162051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.162328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.162600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.163257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:29.163743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.165364 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.179451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1251/2500] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:29.184784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.195829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4d1f0-08db-4feb-90bd-a7a364f769dc None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.202175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.203136 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.203581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.204156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.205090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.208130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.248992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1250/2501] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:29 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:29.250524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.261815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dc4e2-7188-425a-ab6f-875ea1f97b7a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.342521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.343190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.343489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.343737 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.344428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.346434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.354647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:29.373618 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1252/2502] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:29 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:29.378137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.391268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947fe51-12e4-4945-abf6-6154a1f8f337 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.396775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.397553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.397878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.398148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.398788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.400400 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.413363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1251/2503] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:29.417369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.429604 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594bf63-88a6-45db-b6a6-a8315eeb8bbc admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.435246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.435760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.436041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.436316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.436968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.438839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c56e317-aab8-437a-a494-3b6b8674cef9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.451863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1253/2504] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:29.456097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.469018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d58114-05ed-401c-8c0e-b92c8c297b58 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.475817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.476719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.477006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.477293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] PATH_INFO: `/v3/projects/45415e2ac2d34e269d466de054b7597e/users/3cda8d65fcf344139bd3b6dd0df039a9/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.493864 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45415e2ac2d34e269d466de054b7597e, user_id=3cda8d65fcf344139bd3b6dd0df039a9, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.496781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.515349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1252/2505] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:29 2022] PUT /identity/v3/projects/45415e2ac2d34e269d466de054b7597e/users/3cda8d65fcf344139bd3b6dd0df039a9/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:29.528007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.528346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.528614 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.559491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] MFA Rules not processed for user `3cda8d65fcf344139bd3b6dd0df039a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:29.560712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:29.679217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1254/2506] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:29.706064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:29.707964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:29.841770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a8f46-8118-4fef-afbd-7455e0325815 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:29.847775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:29.848396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:29.848676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:29.848949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:29.857980 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:29.859589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c76b30-7420-4da8-be5d-024e25469d84 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:29.869487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1253/2507] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:30.146121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:30.240906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01abeab1-3bd2-4687-a7ec-dd7c28ecb857 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:30.246659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:30.247382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:30.247666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:30.247934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] PATH_INFO: `/v3/users/3cda8d65fcf344139bd3b6dd0df039a9` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:30.249225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cda8d65fcf344139bd3b6dd0df039a9)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:30.251354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:30.319580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cda8d65fcf344139bd3b6dd0df039a9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:30.341521 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cda8d65fcf344139bd3b6dd0df039a9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:30.342882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cda8d65fcf344139bd3b6dd0df039a9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:30.358394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:30.364265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cda8d65fcf344139bd3b6dd0df039a9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:30.365812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cda8d65fcf344139bd3b6dd0df039a9'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:30.386220 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1255/2508] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:30 2022] DELETE /identity/v3/users/3cda8d65fcf344139bd3b6dd0df039a9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:30.388614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:30.388919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:30.389603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:30.413944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:30.415434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:30.435630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:30.507149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1254/2509] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:30.518849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:30.520807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:30.607874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079bc4f-281e-400c-ae1b-ab96b0b0b333 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:30.612064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:30.612702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:30.612978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:30.613254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:30.624455 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:30.627646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:30.641606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1256/2510] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:30.918184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:30.921597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:30.936072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55386fa-8a97-4761-8c44-38cc9629eabf None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:30.941195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:30.942112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:30.942392 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:30.942663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] PATH_INFO: `/v3/users/4a6f819365574091ae344f14e47f487f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:30.944080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a6f819365574091ae344f14e47f487f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:30.946213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:30.980685 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:30.982658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.004188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a6f819365574091ae344f14e47f487f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.015748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a6f819365574091ae344f14e47f487f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.019871 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ff99-7c91-474f-9b2b-bcbb056717c3 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.026349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.027238 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.027559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.027767 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] PATH_INFO: `/v3/projects/45415e2ac2d34e269d466de054b7597e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.028947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] RBAC: Authorizing `identity:delete_project(project_id=45415e2ac2d34e269d466de054b7597e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.030916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.033439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a6f819365574091ae344f14e47f487f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.035477 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a6f819365574091ae344f14e47f487f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.044485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc2def1-c602-478b-a7d6-77fc20b07396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a6f819365574091ae344f14e47f487f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.050857 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1255/2511] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:30 2022] DELETE /identity/v3/users/4a6f819365574091ae344f14e47f487f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:31.083453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45415e2ac2d34e269d466de054b7597e', 'request_id': 'req-8e0ce212-9bb2-43d0-8828-1f07954d712e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.089788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45415e2ac2d34e269d466de054b7597e', 'request_id': 'req-8e0ce212-9bb2-43d0-8828-1f07954d712e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.097179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45415e2ac2d34e269d466de054b7597e', 'request_id': 'req-8e0ce212-9bb2-43d0-8828-1f07954d712e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.114574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] The token cache is being invalidate because project 45415e2ac2d34e269d466de054b7597e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:31.115140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.115860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8e0ce212-9bb2-43d0-8828-1f07954d712e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.117991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1257/2512] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:30 2022] DELETE /identity/v3/projects/45415e2ac2d34e269d466de054b7597e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:31.124438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.125140 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.125731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.147676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:31.148912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.229014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1256/2513] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:31.237924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.238861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.239356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.263062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:31.263230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.264667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.264891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.274831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1258/2514] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:31.278484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.280869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7ae6b-dca0-416e-88ef-ddfef048bb5b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.287474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.288144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.288415 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.288890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] PATH_INFO: `/v3/projects/8aa1c411b57d4e72885dac2b4f4dfe7a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.290119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa1c411b57d4e72885dac2b4f4dfe7a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.292101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.295359 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d81bf-aea5-4afb-98fb-f788f71bc539 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.300155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.300909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.301213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.301529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.302160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:31.302616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.304391 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.321318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1259/2515] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:31.326655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.333724 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:31.339347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005d149-eea4-42d5-bc44-677ab2931679 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.352015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'request_id': 'req-36b68c0d-5d85-46f1-84b6-8bcd239c0213'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.359990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'request_id': 'req-36b68c0d-5d85-46f1-84b6-8bcd239c0213'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.366585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa1c411b57d4e72885dac2b4f4dfe7a', 'request_id': 'req-36b68c0d-5d85-46f1-84b6-8bcd239c0213'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.377547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] The token cache is being invalidate because project 8aa1c411b57d4e72885dac2b4f4dfe7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:31.377894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.378604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-36b68c0d-5d85-46f1-84b6-8bcd239c0213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:31.380224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1257/2516] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:31 2022] DELETE /identity/v3/projects/8aa1c411b57d4e72885dac2b4f4dfe7a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:31.385091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56497ae-e5ce-48ba-8c92-50461b598735 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.385485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56497ae-e5ce-48ba-8c92-50461b598735 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.385832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56497ae-e5ce-48ba-8c92-50461b598735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.390504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:31.402442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.403049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.403331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.403594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.404254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.406178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.409803 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f56497ae-e5ce-48ba-8c92-50461b598735 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:31.411249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f56497ae-e5ce-48ba-8c92-50461b598735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.419919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1258/2517] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:31.430193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.430390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.430644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.437608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1260/2518] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:31.442186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.444347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.457369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:31.458960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.518800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c8f17-07d6-43c0-8fb6-e32eb8c60db7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.524918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.525926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.527019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.527019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.527826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.530105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.543957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1259/2519] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:31.548861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.557448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1261/2520] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:31.559298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.568768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d878-c0f8-4f61-ba5c-b51d05106043 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.572239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3f5e6-f081-49d6-9380-0ba89ba9dcd6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.576298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.577134 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.577499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.578126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.578809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.579129 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:31.579516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.579919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.580419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.580838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.581665 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.581826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.584252 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.600914 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1260/2521] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:31.604880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1262/2522] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:31.605038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.607694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.624328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdee9-2d94-405c-bde4-f71fbe982a5e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.627772 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b79ba-0fce-451f-b037-66872ebf2aeb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.633335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.634430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.634756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.635239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.636096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.637729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.639559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.640184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.640465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.640737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.641493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.648621 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.651788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1263/2523] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:31.658633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.677142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28941a6-03ec-4b67-ac3e-1ab11939c68a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.685120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.685950 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.690730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.690730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] PATH_INFO: `/v3/projects/fd42094d6459444eb5bc89ee2b81c5ec/users/3d2a11c54f214d4c810efe4b86ccd0ad/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.691187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1261/2524] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:31.692167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.708078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd42094d6459444eb5bc89ee2b81c5ec, user_id=3d2a11c54f214d4c810efe4b86ccd0ad, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.710206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe053b41-48ec-436e-8adb-a34a74b0a1de admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.735559 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1264/2525] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:31 2022] PUT /identity/v3/projects/fd42094d6459444eb5bc89ee2b81c5ec/users/3d2a11c54f214d4c810efe4b86ccd0ad/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:31.751127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.751467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.751907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.767503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d51dd6-2fb4-4c71-b52c-3b3e23983376 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.796634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] MFA Rules not processed for user `3d2a11c54f214d4c810efe4b86ccd0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:31.798109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:31.798872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:31.857232 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.858293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.858605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.858881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.859520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.861553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.887698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1265/2526] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:31.887698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.895986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1262/2527] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:31.900029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.904992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f59c7d-11d1-4a46-b2f9-a607743f3aff None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.910712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.911400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.911743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.912078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.912781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.912912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4eb83-14a8-4a39-a690-4e3818c6fed8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:31.914896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.919393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:31.920095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:31.920638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:31.921010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:31.922494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:31.924585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:31.926109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:31.936258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1263/2528] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:31.940567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.948674 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1266/2529] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:31.952424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:31.954733 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377b309-dcee-4762-b13e-8f2880514d26 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.013881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.014807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.015084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.015354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.015997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.017622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.018293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b50da-3f3e-422a-a92a-3840693a55c0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.023112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.023723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.023997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.024270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.024900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.027013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.027692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1264/2530] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:32.031959 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.044711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f61ee-d0ff-41b1-b5c9-4a357f2e0612 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.050327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.050986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.051253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.051626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] PATH_INFO: `/v3/projects/8fba1fce5d474fecbb363f4175ef04ba/users/d68b91da474448089739770f13901c13/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.051719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1267/2531] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:31 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:32.056237 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.066332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e695a-992d-4b97-8411-c572be30a41d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.068802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fba1fce5d474fecbb363f4175ef04ba, user_id=d68b91da474448089739770f13901c13, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.071326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.071525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279a0f-a391-4f44-b68e-18a97ec9f02b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.071910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.072182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.072447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.073077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.074899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.086434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1268/2532] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:32.087953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1265/2533] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:32 2022] PUT /identity/v3/projects/8fba1fce5d474fecbb363f4175ef04ba/users/d68b91da474448089739770f13901c13/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:32.097279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.097802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.098088 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.098363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.107762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dd07b-2684-4372-a998-831c22fb4ee8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.126214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] MFA Rules not processed for user `d68b91da474448089739770f13901c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:32.127450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:32.167983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.168671 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.169229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.169555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] PATH_INFO: `/v3/projects/2086a0c8148a453eb70e893184d6bccc/users/a35e2894e52a467d8b0a11e8e61faf5f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.184560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2086a0c8148a453eb70e893184d6bccc, user_id=a35e2894e52a467d8b0a11e8e61faf5f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.187427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.188708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:32.193121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1266/2534] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:32.203951 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.205205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1269/2535] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:32 2022] PUT /identity/v3/projects/2086a0c8148a453eb70e893184d6bccc/users/a35e2894e52a467d8b0a11e8e61faf5f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:32.205388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:32.209100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.263165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:32.283162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e680b-3070-49fa-ac88-e397231af279 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.288003 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.288193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8632a1-654f-40cf-9cdf-e5463eeea8b9 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.288620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.289055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.289520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.290278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.291900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.302703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1270/2536] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:32.308245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.323546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634958e-1ff9-44b2-8409-fececac763dd admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.328375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.329101 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.329493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.329831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] PATH_INFO: `/v3/projects/2086a0c8148a453eb70e893184d6bccc/users/a35e2894e52a467d8b0a11e8e61faf5f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.332503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2086a0c8148a453eb70e893184d6bccc, user_id=a35e2894e52a467d8b0a11e8e61faf5f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.335371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8410aa6-f818-4c1a-9310-b062c0d381bb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.347326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1271/2537] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:32 2022] PUT /identity/v3/projects/2086a0c8148a453eb70e893184d6bccc/users/a35e2894e52a467d8b0a11e8e61faf5f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:32.358992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.359270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.359547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.373527 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.374409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.374874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.375294 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.398235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] MFA Rules not processed for user `a35e2894e52a467d8b0a11e8e61faf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:32.399506 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:32.440304 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.442404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.452311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1267/2538] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:27:32.470148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1272/2539] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:32.481884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.483402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:32.523872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:32.542627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b3d52-8395-4c19-bf0a-cd6aba57ebb8 service nova] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.594250 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.594979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.595298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.597505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.610217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.612251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893432a-54ec-4a20-adc5-5a4bbbb61cb4 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.623873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1268/2540] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:32.653001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.716998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a294f8-7785-4be8-bda7-060f02620adf None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:32.723814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:32.724461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.724735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.724999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] PATH_INFO: `/v3/users/3d2a11c54f214d4c810efe4b86ccd0ad` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.726258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2a11c54f214d4c810efe4b86ccd0ad)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:32.728374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:32.785001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2a11c54f214d4c810efe4b86ccd0ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:32.795723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:32.798897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2a11c54f214d4c810efe4b86ccd0ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:32.800012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2a11c54f214d4c810efe4b86ccd0ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:32.810784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2a11c54f214d4c810efe4b86ccd0ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:32.812025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2a11c54f214d4c810efe4b86ccd0ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:32.827007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1273/2541] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:32 2022] DELETE /identity/v3/users/3d2a11c54f214d4c810efe4b86ccd0ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:32.831587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e996-9899-443b-9707-da43ce9aaaaa None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:32.831884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e996-9899-443b-9707-da43ce9aaaaa None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:32.832161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42e996-9899-443b-9707-da43ce9aaaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:32.855150 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3d42e996-9899-443b-9707-da43ce9aaaaa None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:32.856382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3d42e996-9899-443b-9707-da43ce9aaaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:32.922357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1269/2542] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:32.935943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:32.937501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:33.014873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba912ea-4747-4409-9c8b-b87d8eeca34a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:33.018038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:33.018510 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:33.018863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:33.019472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:33.020089 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:33.020362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:33.020625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:33.037426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:33.038850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:33.039890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:33.041219 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:33.049378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1274/2543] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:33.106539 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1270/2544] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:27:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:33.123040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:33.124293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:33.212673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b0efa-8c2d-483b-b559-688a2b078740 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:33.219158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:33.219877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:33.220155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:33.220429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:33.231209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:33.232861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:33.243789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1275/2545] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:27:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:27:33.395966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:33.398352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:33.415809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504a3cb-4c46-4ded-af87-4e53064741de None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:33.437716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:33.438390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:33.438678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:33.438956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] PATH_INFO: `/v3/projects/fd42094d6459444eb5bc89ee2b81c5ec` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:33.450371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd42094d6459444eb5bc89ee2b81c5ec)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:33.452418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:33.506053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:33.527829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd42094d6459444eb5bc89ee2b81c5ec', 'request_id': 'req-19744279-beb4-443a-98b0-0a00fe0a12d2'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.539145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd42094d6459444eb5bc89ee2b81c5ec', 'request_id': 'req-19744279-beb4-443a-98b0-0a00fe0a12d2'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.551967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd42094d6459444eb5bc89ee2b81c5ec', 'request_id': 'req-19744279-beb4-443a-98b0-0a00fe0a12d2'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.565221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] The token cache is being invalidate because project fd42094d6459444eb5bc89ee2b81c5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:33.565640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.566572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.568184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1271/2546] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:33 2022] DELETE /identity/v3/projects/fd42094d6459444eb5bc89ee2b81c5ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:33.572388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:33.585204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617db27a-30da-4a8e-a858-9647ab76b907 service swift] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:33.686964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:33.687707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:33.688044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:33.688386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] PATH_INFO: `/v3/users/a35e2894e52a467d8b0a11e8e61faf5f` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:33.689780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35e2894e52a467d8b0a11e8e61faf5f)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:33.691874 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:33.709020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:33.755295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35e2894e52a467d8b0a11e8e61faf5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.774375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35e2894e52a467d8b0a11e8e61faf5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.775066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35e2894e52a467d8b0a11e8e61faf5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.785131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35e2894e52a467d8b0a11e8e61faf5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.786052 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f7589e89-6bc2-473e-8500-c91aa6dc6cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35e2894e52a467d8b0a11e8e61faf5f'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:33.802505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1276/2547] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:33 2022] DELETE /identity/v3/users/a35e2894e52a467d8b0a11e8e61faf5f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:34.170307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.170307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:34.202354 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19744279-beb4-443a-98b0-0a00fe0a12d2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.281259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.281987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.282311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.282915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] PATH_INFO: `/v3/projects/2086a0c8148a453eb70e893184d6bccc` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.284161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2086a0c8148a453eb70e893184d6bccc)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.286160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.352524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2086a0c8148a453eb70e893184d6bccc', 'request_id': 'req-5e471197-7d02-48c0-af28-084af9c536d8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:34.370351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2086a0c8148a453eb70e893184d6bccc', 'request_id': 'req-5e471197-7d02-48c0-af28-084af9c536d8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:34.379367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2086a0c8148a453eb70e893184d6bccc', 'request_id': 'req-5e471197-7d02-48c0-af28-084af9c536d8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:34.393695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] The token cache is being invalidate because project 2086a0c8148a453eb70e893184d6bccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:34.394109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:34.394930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5e471197-7d02-48c0-af28-084af9c536d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:34.396569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1272/2548] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:34 2022] DELETE /identity/v3/projects/2086a0c8148a453eb70e893184d6bccc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:27:34.402137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.402425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.402699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.423245 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:34.424634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:34.492332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1277/2549] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:34.501072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.501345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.501656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.523310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:34.524547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:34.539926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1273/2550] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:34.541453 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.553650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a6f0e-1cff-4991-a846-54f2fa65278d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.559378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.560015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.562289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.562289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.562289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:34.562289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.563164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.577555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1278/2551] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:34.582330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.593328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b40c74-c7f9-4e6f-acc5-929365c69331 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.600062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.600695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.600973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.601247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.601950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.603909 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.634974 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1274/2552] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:34 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:34.640403 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.658048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d0a6-c4f7-4ed8-b82c-b036ded895ee admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.742120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.742813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.743130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.743393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.744142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.746602 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.774335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1279/2553] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:34 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:34.779633 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.795296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa7fe0-1a34-4858-b14c-aee9f311d134 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.801051 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.801874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.802240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.802613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.803796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.806402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.820393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1275/2554] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:34.825500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.841815 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d56aa3-4382-4688-acbd-de5f7003b822 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.849563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.850259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.850593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.850984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.852030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.854031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d158d-bb1d-4210-b12a-115453317b41 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.856066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:34.871073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1280/2555] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:34.882438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:34.897940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6287-7e52-48df-ae00-86d80c3a96ae admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:34.907025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:34.908110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.910049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.910791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] PATH_INFO: `/v3/projects/f773d073ccf4456eb243164c86b38905/users/0b32b94888ae416ca47398740fd012e6/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.927670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:34.933520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f773d073ccf4456eb243164c86b38905, user_id=0b32b94888ae416ca47398740fd012e6, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:34.938037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:34.954606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1276/2556] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:34 2022] PUT /identity/v3/projects/f773d073ccf4456eb243164c86b38905/users/0b32b94888ae416ca47398740fd012e6/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:34.965218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2142-6641-45d7-8bab-855828c52477 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:34.965662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2142-6641-45d7-8bab-855828c52477 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:34.966048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b2142-6641-45d7-8bab-855828c52477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:34.997997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-171b2142-6641-45d7-8bab-855828c52477 None None] MFA Rules not processed for user `0b32b94888ae416ca47398740fd012e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:34.999450 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-171b2142-6641-45d7-8bab-855828c52477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:35.071443 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1281/2557] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:35.076311 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.146876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dea610-4412-4158-8a7e-063fa9a7af72 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.152295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.152981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.153363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.153706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.154398 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.156378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.188257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1277/2558] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:35 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:35.192861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b2142-6641-45d7-8bab-855828c52477 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.205048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b2142-6641-45d7-8bab-855828c52477 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.276308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.277025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.277352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.277666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.278352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.280382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.306656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1282/2559] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:35 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:35.313189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.329261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cbff0-b92f-4a0f-82e5-247618928023 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.335442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.336206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.336591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.336955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.337778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.339608 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.352960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1278/2560] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:35.357565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.368796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752df72-5821-490c-a159-d100dfea3095 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.373859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.374473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.374919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.375186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.375849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.377576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8061742-f89e-4f6d-aeb9-77fc4f5dd806 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.390032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1283/2561] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:35.395255 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.414271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd18ef72-6654-4560-9d4a-d8fff09cea9d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.415029 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.415882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.416323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.416671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] PATH_INFO: `/v3/projects/d4de3207719d4b239c4ddb9c42e1dace/users/c5a483b08ab0407ab29f820174a81752/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.436145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4de3207719d4b239c4ddb9c42e1dace, user_id=c5a483b08ab0407ab29f820174a81752, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.438897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.458526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1279/2562] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:35 2022] PUT /identity/v3/projects/d4de3207719d4b239c4ddb9c42e1dace/users/c5a483b08ab0407ab29f820174a81752/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:35.470628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.470932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.471189 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.503114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] MFA Rules not processed for user `c5a483b08ab0407ab29f820174a81752`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:35.504989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:35.567636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:35.580779 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1284/2563] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:35.585642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.687440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3f23f-88bb-41b2-8a20-8905adf8d79f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.696064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.697112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.697667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.698176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.699362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.703169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.743115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1280/2564] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:35 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:35.747919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.761013 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134e37a-4816-4bad-b85e-1da5a93f7973 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.827375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.828044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.828356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.828687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.829379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.831475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.856695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1285/2565] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:35 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:35.862702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.874321 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52c8d-f19a-47bc-b7d7-a3ca8bb157fd admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.880190 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.880807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.881101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.881426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.882091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.883759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.896487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1281/2566] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:35.901044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.912358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d56b66-0567-4a66-a52a-b12c9268c586 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:35.919805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:35.921185 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:35.921809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:35.922299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] PATH_INFO: `/v3/projects/db90d8007f704058af54bd5d8e4153be/users/f06e42ac116145d8b1b4cb1540b25664/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:35.950141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db90d8007f704058af54bd5d8e4153be, user_id=f06e42ac116145d8b1b4cb1540b25664, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:35.955676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:35.976909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1286/2567] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:35 2022] PUT /identity/v3/projects/db90d8007f704058af54bd5d8e4153be/users/f06e42ac116145d8b1b4cb1540b25664/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:35.981520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:35.993677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ebf3c-019a-48d1-a4ec-312fdd4b721e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:36.010945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:36.084466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:36.084985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:36.085269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:36.085568 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:36.086261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:36.088069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b18867-4f0b-4b16-a541-82365c8beafd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:36.099154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1282/2568] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:36.105744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:36.119153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d6b78-75fd-4ca9-904b-4089241ad330 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:36.125294 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:36.126063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:36.126385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:36.126720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] PATH_INFO: `/v3/projects/db90d8007f704058af54bd5d8e4153be/users/f06e42ac116145d8b1b4cb1540b25664/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:36.129014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db90d8007f704058af54bd5d8e4153be, user_id=f06e42ac116145d8b1b4cb1540b25664, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:36.132183 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:36.146553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1287/2569] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:36 2022] PUT /identity/v3/projects/db90d8007f704058af54bd5d8e4153be/users/f06e42ac116145d8b1b4cb1540b25664/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:36.157680 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:36.158170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:36.158673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:36.188281 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] MFA Rules not processed for user `f06e42ac116145d8b1b4cb1540b25664`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:36.189561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:36.261978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1283/2570] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:36.273820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:36.275622 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:36.349007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc0136-5e02-4e0c-b7f8-90ea0e77d6f0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:36.353066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:36.353722 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:36.354002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:36.354399 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:36.365296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:36.366910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:36.379445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1288/2571] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:37.096888 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:37.098981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:37.114367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653e7cb-9bab-4496-b454-b4afe97ba467 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:37.119011 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:37.119717 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:37.120000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:37.120273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:37.197501 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:37.199121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0adbf-8def-47a8-a9ae-a9fd9de4f92c service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:37.210583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1284/2572] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:37.991836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:37.991836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:38.072846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:38.103877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1614b85-8603-46a6-af8a-3be2e7471e81 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:38.110412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:38.111404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:38.111793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:38.112114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] PATH_INFO: `/v3/users/d68b91da474448089739770f13901c13` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:38.113627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68b91da474448089739770f13901c13)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:38.115743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:38.185711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68b91da474448089739770f13901c13'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.205899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68b91da474448089739770f13901c13'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.207151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68b91da474448089739770f13901c13'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.217498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68b91da474448089739770f13901c13'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.218166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68b91da474448089739770f13901c13'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.233513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1289/2573] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:37 2022] DELETE /identity/v3/users/d68b91da474448089739770f13901c13 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:38.238759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:38.239315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:38.239315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:38.266870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:38.268957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:38.311932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:38.356360 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1285/2574] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:38.367841 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:38.369546 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:38.446282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfcd13-c777-4e7a-9a2b-154b2acd54d8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:38.450834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:38.451590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:38.452014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:38.452363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:38.464449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:38.466164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e93c5-63ae-4b5b-b250-a5b32b14dfbb service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:38.481095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1290/2575] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:38.843769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:38.847892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:38.884913 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1ac35-b575-4614-91be-c79fe5c5116c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:38.893962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:38.895374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:38.895799 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:38.896263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] PATH_INFO: `/v3/projects/8fba1fce5d474fecbb363f4175ef04ba` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:38.898379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fba1fce5d474fecbb363f4175ef04ba)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:38.903694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:38.971100 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fba1fce5d474fecbb363f4175ef04ba', 'request_id': 'req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.982971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fba1fce5d474fecbb363f4175ef04ba', 'request_id': 'req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:38.992045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fba1fce5d474fecbb363f4175ef04ba', 'request_id': 'req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:39.007677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] The token cache is being invalidate because project 8fba1fce5d474fecbb363f4175ef04ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:39.008168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:39.009296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-59461ac9-b3f5-4ff6-a2af-b1e3ce4ca54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:39.011237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1286/2576] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:38 2022] DELETE /identity/v3/projects/8fba1fce5d474fecbb363f4175ef04ba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:39.019856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.020694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.020694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.043735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:39.045454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:39.146347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1291/2577] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:39.155407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.155715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.155990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.179482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:39.180893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:39.190475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1287/2578] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:39.195142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.206034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d79e47-c1da-4e6f-8e2a-dc8b335390f5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.211025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.211632 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.211903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.212173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.212819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:39.213112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.214879 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.223051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:39.229909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1292/2579] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:39.236761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.251581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c0a3e-bbbd-4aa5-9447-cdc796690d1f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.257148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.257830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.258110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.258386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.259279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.261609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.297341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1288/2580] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:39.302577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.315807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcc3cb-4976-4e53-b9cd-445fb1b95e4e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.388456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.389335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.389832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.390153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.390988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.393775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.418834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1293/2581] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:39.423490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.435085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f642b-feff-4c7c-bc96-40f889346110 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.440460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.441097 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.441388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.441690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.442434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.444273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.456553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1289/2582] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:39.462270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.473659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca9429-0a34-4309-b301-f3095f9da96f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.479457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.480191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.480501 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.480881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.481911 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.483842 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4ac0-6c7a-4f39-b9bc-485f52b29206 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.496293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1294/2583] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:39.503259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.517302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481acd1a-9ec3-4cd4-8c56-e8fc61c2b793 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.523264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.523934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.524220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.524509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] PATH_INFO: `/v3/projects/7378f53ca3e447838ec392efa6c56a5a/users/66d328f63a114b05b18bd160ccb78149/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.542823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7378f53ca3e447838ec392efa6c56a5a, user_id=66d328f63a114b05b18bd160ccb78149, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.545873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.562544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1290/2584] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:39 2022] PUT /identity/v3/projects/7378f53ca3e447838ec392efa6c56a5a/users/66d328f63a114b05b18bd160ccb78149/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:39.575825 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.576330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.576711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.612613 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] MFA Rules not processed for user `66d328f63a114b05b18bd160ccb78149`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:39.614435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:39.696300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1295/2585] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:39.701698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.759290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:39.772456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd81f1-9521-42ba-b957-5747546dc118 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.781838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.782933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.783308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.783778 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.784926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.787896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.837154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1291/2586] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:39.838793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.855980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb0e31-0199-4756-85de-a8e13f9f1040 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.938009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.938846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.939209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.939478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.940153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:39.942334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:39.955349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:39.973620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1296/2587] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:39 2022] POST /identity/v3/users => generated 291 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:39.974739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:39.988700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b287d-e0e9-402e-bb32-563e4946398e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:39.996022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:39.996975 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:39.997338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:39.997802 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:39.999035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.001421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.019550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1292/2588] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:40.020968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:40.032992 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e219665-2ea5-4200-bb33-1a7a32333b0a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:40.038314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:40.039171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.039427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.039679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] PATH_INFO: `/v3/projects/6901dc9ed68b4ab49e542158baab23bf/users/3cdf57a7fdcd429f8e12af072993313b/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.058995 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6901dc9ed68b4ab49e542158baab23bf, user_id=3cdf57a7fdcd429f8e12af072993313b, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.062244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.079126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1297/2589] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:40 2022] PUT /identity/v3/projects/6901dc9ed68b4ab49e542158baab23bf/users/3cdf57a7fdcd429f8e12af072993313b/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:40.083677 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:40.096849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a39451-64f2-4e3b-951d-0ef229f3aca8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:40.192031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:40.192662 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.192963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.193262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.193929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.195560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aa07f-94bc-4ebf-ab56-27a5f9fa6ed4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.208676 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1293/2590] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:40.213285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:40.226228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df928e-894d-4b80-a7a3-cc5b62a60034 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:40.233330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:40.234407 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.234915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.236160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] PATH_INFO: `/v3/projects/6901dc9ed68b4ab49e542158baab23bf/users/3cdf57a7fdcd429f8e12af072993313b/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.240164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6901dc9ed68b4ab49e542158baab23bf, user_id=3cdf57a7fdcd429f8e12af072993313b, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.246214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.265824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1298/2591] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:40 2022] PUT /identity/v3/projects/6901dc9ed68b4ab49e542158baab23bf/users/3cdf57a7fdcd429f8e12af072993313b/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:40.278124 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.279025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.279702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.343104 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] MFA Rules not processed for user `3cdf57a7fdcd429f8e12af072993313b`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:40.345550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:40.451239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1294/2592] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:40.465371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:40.467620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:40.572775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46080d42-6537-48ad-9e69-46acb21ac1e6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:40.587012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:40.587682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.587948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.588249 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.603729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.605229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.617829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1299/2593] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:40.708461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:40.722315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a936392-db88-4c91-b520-25e6c9f7abbe None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:40.727043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:40.727948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:40.728238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:40.728572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:40.789427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:40.805355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:40.808370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:40.825257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1295/2594] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:41.647342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:41.656721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615f33-a3cf-47c6-8821-22793e162bdd service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:41.660935 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:41.661738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:41.662017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:41.662285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:41.664063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:41.740924 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:41.743014 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42306255-b1f6-4a36-ae90-997a8f05ac5e service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:41.755728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1300/2595] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:44.243303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:44.244940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:44.339993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace723e-78e2-4efe-b8a1-dfda4106ffc8 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:44.345114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:44.345937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:44.346969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:44.347314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] PATH_INFO: `/v3/users/0b32b94888ae416ca47398740fd012e6` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:44.348513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b32b94888ae416ca47398740fd012e6)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:44.350517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:44.406961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b32b94888ae416ca47398740fd012e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:44.416295 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b32b94888ae416ca47398740fd012e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:44.431231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b32b94888ae416ca47398740fd012e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:44.431962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b32b94888ae416ca47398740fd012e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:44.439596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b32b94888ae416ca47398740fd012e6'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:44.446551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1296/2596] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:44 2022] DELETE /identity/v3/users/0b32b94888ae416ca47398740fd012e6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:44.451698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:44.452412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:44.452412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:44.474329 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:44.475741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:44.537939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:44.553337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1301/2597] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:44.562141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:44.563920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:44.632849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63594404-229c-4a16-9d71-fb4ce04b99fa admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:44.637668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:44.638299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:44.638579 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:44.639159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:44.650525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:44.652164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:44.664565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1297/2598] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:45.011540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:45.014673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:45.045113 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08493f-87ac-421a-b26b-95c3fb4e9928 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:45.055357 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:45.056475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:45.056847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:45.057335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] PATH_INFO: `/v3/projects/f773d073ccf4456eb243164c86b38905` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:45.059040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f773d073ccf4456eb243164c86b38905)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:45.061298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:45.135278 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f773d073ccf4456eb243164c86b38905', 'request_id': 'req-19f1340a-cce3-4f74-bbdd-c20bf6277260'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.142127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f773d073ccf4456eb243164c86b38905', 'request_id': 'req-19f1340a-cce3-4f74-bbdd-c20bf6277260'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.149937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f773d073ccf4456eb243164c86b38905', 'request_id': 'req-19f1340a-cce3-4f74-bbdd-c20bf6277260'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.166758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] The token cache is being invalidate because project f773d073ccf4456eb243164c86b38905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:45.166970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.167598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.169286 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1302/2599] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:45 2022] DELETE /identity/v3/projects/f773d073ccf4456eb243164c86b38905 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:45.173878 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:45.184986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be095e6d-f17d-47fb-a796-2e08ff9839cb service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:45.191832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:45.272228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:45.273183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:45.273183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:45.274052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] PATH_INFO: `/v3/users/c5a483b08ab0407ab29f820174a81752` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:45.275467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a483b08ab0407ab29f820174a81752)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:45.278745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:45.355592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a483b08ab0407ab29f820174a81752'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.367315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a483b08ab0407ab29f820174a81752'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.384542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a483b08ab0407ab29f820174a81752'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.385443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a483b08ab0407ab29f820174a81752'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.396287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a483b08ab0407ab29f820174a81752'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.403344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1298/2600] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:45 2022] DELETE /identity/v3/users/c5a483b08ab0407ab29f820174a81752 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:27:45.811899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:45.814435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:45.835379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1340a-cce3-4f74-bbdd-c20bf6277260 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:45.916623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:45.917336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:45.917660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:45.918022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] PATH_INFO: `/v3/projects/d4de3207719d4b239c4ddb9c42e1dace` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:45.919313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4de3207719d4b239c4ddb9c42e1dace)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:45.921759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:45.974741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4de3207719d4b239c4ddb9c42e1dace', 'request_id': 'req-c8fb7e4a-3947-4117-b5f7-42801be326f0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.981459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4de3207719d4b239c4ddb9c42e1dace', 'request_id': 'req-c8fb7e4a-3947-4117-b5f7-42801be326f0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:45.988836 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4de3207719d4b239c4ddb9c42e1dace', 'request_id': 'req-c8fb7e4a-3947-4117-b5f7-42801be326f0'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.003468 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] The token cache is being invalidate because project d4de3207719d4b239c4ddb9c42e1dace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:46.003759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.004447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.006002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1303/2601] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:45 2022] DELETE /identity/v3/projects/d4de3207719d4b239c4ddb9c42e1dace => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:27:46.010253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:46.011876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:46.025557 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f8322-28b0-41be-9365-aa7bc0344617 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:46.087983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:46.088639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:46.088917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:46.089210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] PATH_INFO: `/v3/users/f06e42ac116145d8b1b4cb1540b25664` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:46.090506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06e42ac116145d8b1b4cb1540b25664)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:46.092453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:46.129126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:46.144469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06e42ac116145d8b1b4cb1540b25664'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.152261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06e42ac116145d8b1b4cb1540b25664'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.167491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06e42ac116145d8b1b4cb1540b25664'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.168444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06e42ac116145d8b1b4cb1540b25664'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.177985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-98e576a4-6f23-43ca-8cdd-53acd11c5002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06e42ac116145d8b1b4cb1540b25664'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.184723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1299/2602] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:46 2022] DELETE /identity/v3/users/f06e42ac116145d8b1b4cb1540b25664 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:46.566495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:46.571485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:46.629293 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb7e4a-3947-4117-b5f7-42801be326f0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:46.646071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:46.715830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:46.716497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:46.716794 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:46.717069 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] PATH_INFO: `/v3/projects/db90d8007f704058af54bd5d8e4153be` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:46.718274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db90d8007f704058af54bd5d8e4153be)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:46.720277 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:46.783296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db90d8007f704058af54bd5d8e4153be', 'request_id': 'req-f76215b5-9443-4b65-a638-5c2f0038022d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.789734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db90d8007f704058af54bd5d8e4153be', 'request_id': 'req-f76215b5-9443-4b65-a638-5c2f0038022d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.797307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db90d8007f704058af54bd5d8e4153be', 'request_id': 'req-f76215b5-9443-4b65-a638-5c2f0038022d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.815429 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] The token cache is being invalidate because project db90d8007f704058af54bd5d8e4153be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:46.816387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.816918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-f76215b5-9443-4b65-a638-5c2f0038022d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:46.825770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1304/2603] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:46 2022] DELETE /identity/v3/projects/db90d8007f704058af54bd5d8e4153be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:27:46.826022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:46.826022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:46.826022 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:46.851195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:46.852824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:46.936302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1300/2604] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:46.945302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:46.945918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:46.946196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:46.977140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:46.978640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:46.993533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1305/2605] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:46.995993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.007572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77f69-8e74-4714-b76a-fa7faeeef99c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.012814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.013537 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.014151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.014438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.015128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:47.015438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.017069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.033266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1301/2606] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:47.039380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.059071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac1c2-ca8b-408a-ada8-0c4e5383ee3b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.066431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.067513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.068225 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.068847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.069797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.073187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.126086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1306/2607] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:47 2022] POST /identity/v3/projects => generated 401 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:47.130885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.144942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3230c5-4e3a-4c5a-9ed6-f00628826462 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.220812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.221460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.221743 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.222014 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.222666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.224661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.252668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1302/2608] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:47 2022] POST /identity/v3/users => generated 301 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:47.258068 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.272956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc9439-924c-444f-8ffb-6d3da8a52432 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.280887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.281579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.281957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.282296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.283180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.285161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.297439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1307/2609] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:47.304383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.317957 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8e0a5-9a99-4993-9f87-91ecacc32a55 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.324932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.325187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.325502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.325810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.326559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.328427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da005a7-2747-4301-b649-49c35bf944e1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.340985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1303/2610] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:47.350182 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.362507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda87bfc-41de-4b77-b184-e2d75290ac8b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.368184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.369022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.369297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.369691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] PATH_INFO: `/v3/projects/38490d15a1fe45aaba6138afadf4eb60/users/9875a020373442a68701868034c14ae5/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.395891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38490d15a1fe45aaba6138afadf4eb60, user_id=9875a020373442a68701868034c14ae5, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.398833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.414959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1308/2611] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:47 2022] PUT /identity/v3/projects/38490d15a1fe45aaba6138afadf4eb60/users/9875a020373442a68701868034c14ae5/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:47.428942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.429371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.429699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.465460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:47.471426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] MFA Rules not processed for user `9875a020373442a68701868034c14ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:47.473189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:47.552838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1304/2612] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:47 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:47.558148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.618016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:47.644525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc982da-b871-4690-a8e5-5487833b4be8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.650045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.650659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.650971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.651292 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.651939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.653913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.693938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1309/2613] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:47 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:47.697854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.718639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5c3f6-29f2-4e35-b0b3-9f18b8c5484d None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.779744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.780362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.780637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.780920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.781598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.783590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.808163 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1305/2614] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:47 2022] POST /identity/v3/users => generated 306 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:47.813715 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.828396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff8e5b-0766-4451-bc92-4a731d0246e5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.833920 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.834762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.835063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.835727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.836580 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.838558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.853017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1310/2615] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:47.858826 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.870486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df057c-2785-490b-9492-0ff5c10df43f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.876820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.877545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.877824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.878098 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] PATH_INFO: `/v3/projects/f01e136a349f4757aaaf14e7cadf6e20/users/8d8a0a07970347d08d277adaf557711a/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.897522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e136a349f4757aaaf14e7cadf6e20, user_id=8d8a0a07970347d08d277adaf557711a, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:47.900256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:47.914470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1306/2616] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:47 2022] PUT /identity/v3/projects/f01e136a349f4757aaaf14e7cadf6e20/users/8d8a0a07970347d08d277adaf557711a/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:47.919123 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:47.930635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0883169-31fe-4f7e-a1df-e6b510f8a52c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:47.997264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:47.998043 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:47.998323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:47.998594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:47.999258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:48.000938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d69bf3-6b35-4ff4-8a5e-c860b1c2f10d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:48.012383 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1311/2617] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:48.017671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:48.030280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94296955-82e5-47a6-8939-819bfc6e69c3 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:48.036385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:48.037065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:48.037339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:48.037642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] PATH_INFO: `/v3/projects/f01e136a349f4757aaaf14e7cadf6e20/users/8d8a0a07970347d08d277adaf557711a/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:48.039821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e136a349f4757aaaf14e7cadf6e20, user_id=8d8a0a07970347d08d277adaf557711a, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:48.042640 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:48.055584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1307/2618] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:48 2022] PUT /identity/v3/projects/f01e136a349f4757aaaf14e7cadf6e20/users/8d8a0a07970347d08d277adaf557711a/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:48.067588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:48.067972 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:48.068348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:48.105250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] MFA Rules not processed for user `8d8a0a07970347d08d277adaf557711a`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:48.106498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:48.196157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1312/2619] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:48.208347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:48.210267 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:48.278160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812488cd-13f9-4453-a56a-158643ca689d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:48.282338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:48.282979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:48.283257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:48.283522 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:48.293434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:48.294925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:48.299274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:48.313563 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1308/2620] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:48.405512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:48.417086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1f50b-f889-420c-b71c-d827652d0d28 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:48.421916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:48.422583 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:48.422860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:48.423129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:48.461162 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:48.494096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:48.495547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316e938-c157-4502-b88d-9e333a7ae02a service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:48.506457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1313/2621] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:48 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:52.861613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:52.947380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31eb0e-df5c-4b86-b17e-c1323d75fc62 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:52.952428 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:52.953084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:52.953365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:52.953669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] PATH_INFO: `/v3/users/9875a020373442a68701868034c14ae5` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:52.954870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9875a020373442a68701868034c14ae5)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:52.956829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:53.045685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9875a020373442a68701868034c14ae5'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.058988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9875a020373442a68701868034c14ae5'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.074764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9875a020373442a68701868034c14ae5'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.075590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9875a020373442a68701868034c14ae5'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.082906 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9875a020373442a68701868034c14ae5'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.089548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1309/2622] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:52 2022] DELETE /identity/v3/users/9875a020373442a68701868034c14ae5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:53.096044 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:53.096629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:53.096762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:53.116791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:53.118210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:53.191912 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1314/2623] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:27:53.204253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:53.206043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:53.270642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4ffdd-863c-417a-b915-5518c529043d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:53.275159 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:53.275783 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:53.276070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:53.276470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:53.287329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:53.288827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:53.300239 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1310/2624] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:27:53.619944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:53.621788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:53.638151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e639eea-497d-455f-810f-a2a831295bc6 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:53.644627 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:53.645441 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:53.645840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:53.646199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] PATH_INFO: `/v3/projects/38490d15a1fe45aaba6138afadf4eb60` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:53.648412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] RBAC: Authorizing `identity:delete_project(project_id=38490d15a1fe45aaba6138afadf4eb60)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:53.650837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:53.704246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38490d15a1fe45aaba6138afadf4eb60', 'request_id': 'req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.710152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38490d15a1fe45aaba6138afadf4eb60', 'request_id': 'req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.717210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38490d15a1fe45aaba6138afadf4eb60', 'request_id': 'req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.733760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] The token cache is being invalidate because project 38490d15a1fe45aaba6138afadf4eb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:53.734065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.734787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.736658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1315/2625] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:53 2022] DELETE /identity/v3/projects/38490d15a1fe45aaba6138afadf4eb60 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:53.740809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:53.750927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a56e6e-9001-4a03-8eac-47bffc22796a service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:53.769126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:53.824965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:53.825970 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:53.826252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:53.826529 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] PATH_INFO: `/v3/users/8d8a0a07970347d08d277adaf557711a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:53.827976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8a0a07970347d08d277adaf557711a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:53.830031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:53.883442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8a0a07970347d08d277adaf557711a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.894057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8a0a07970347d08d277adaf557711a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.909899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8a0a07970347d08d277adaf557711a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.910731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8a0a07970347d08d277adaf557711a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.922037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-96172bee-f64c-4d94-8150-8c13bb4fe38b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8a0a07970347d08d277adaf557711a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:53.933343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1311/2626] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:27:53 2022] DELETE /identity/v3/users/8d8a0a07970347d08d277adaf557711a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:54.256670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.258576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:54.273134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281acf4f-df4f-4acf-bb2d-dddd4b8cb67a admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.333822 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:54.341777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.342926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.343581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.344464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] PATH_INFO: `/v3/projects/f01e136a349f4757aaaf14e7cadf6e20` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.346932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01e136a349f4757aaaf14e7cadf6e20)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.349805 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.420962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01e136a349f4757aaaf14e7cadf6e20', 'request_id': 'req-408ac831-fe80-4369-ade9-d367422496dc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:54.429481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01e136a349f4757aaaf14e7cadf6e20', 'request_id': 'req-408ac831-fe80-4369-ade9-d367422496dc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:54.438996 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01e136a349f4757aaaf14e7cadf6e20', 'request_id': 'req-408ac831-fe80-4369-ade9-d367422496dc'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:54.456762 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] The token cache is being invalidate because project f01e136a349f4757aaaf14e7cadf6e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:27:54.457129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:54.458426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-408ac831-fe80-4369-ade9-d367422496dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:27:54.459990 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1316/2627] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:27:54 2022] DELETE /identity/v3/projects/f01e136a349f4757aaaf14e7cadf6e20 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:54.465247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.465595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.465850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.489911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:54.492535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:54.626988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1312/2628] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:54.635829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.636115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.636394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.666504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:54.668241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:54.678798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1317/2629] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:54.684083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.695667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39720e04-70a9-48b7-b9b0-d92caf759826 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.700391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.701005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.701283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.701585 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.702246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:27:54.702588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.704160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.721043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1313/2630] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:27:54.722317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.733532 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c61f71-f4cb-4545-8925-175c0a2b5fec None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.738535 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.739281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.739556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.739831 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.740482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.742494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.774865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1318/2631] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:54 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:27:54.779317 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.791919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3cb1-2268-4d6b-93bd-473d32b25da5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.835855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:54.879643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.880330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.880614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.880911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.881747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.883728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.907049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1314/2632] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:54 2022] POST /identity/v3/users => generated 304 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:54.911400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.922522 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d36e5-8f6d-49a4-967a-81e9a3388136 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.929355 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.930010 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.930285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.930591 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.931445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.933503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.956006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1319/2633] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:54.960504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:54.972268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee26dc-097d-4a91-9150-3e3ad302f484 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:54.978210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:54.978928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:54.979240 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:54.979670 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:54.980221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:54.982161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed205502-3821-4ad3-8dd9-9e6fc13e981f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:54.994923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1315/2634] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:55.000617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.012866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c7aa3-8e1f-4ffe-878a-7b13891c7a96 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.019096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.019783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.020057 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.020328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] PATH_INFO: `/v3/projects/4a9a070cf8ba4b4092700daf577542a0/users/d6a40e5d38ef407e8dabdc099f95304f/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.038968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9a070cf8ba4b4092700daf577542a0, user_id=d6a40e5d38ef407e8dabdc099f95304f, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.042366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.058254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1320/2635] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:54 2022] PUT /identity/v3/projects/4a9a070cf8ba4b4092700daf577542a0/users/d6a40e5d38ef407e8dabdc099f95304f/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:55.070490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.070976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.071141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.106047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] MFA Rules not processed for user `d6a40e5d38ef407e8dabdc099f95304f`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:55.107310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:55.181358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1316/2636] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:55.186870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.281670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada8ba0-49dc-4540-8ec6-dffc928205c2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.286832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.287477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.287756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.288025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.288653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.290605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.324782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1321/2637] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:27:55 2022] POST /identity/v3/projects => generated 407 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:55.329155 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.342117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeff64e-5763-49c7-a466-eaf48f8c15ab None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.403981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.404641 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.404935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.405207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.405881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.408145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.432553 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1317/2638] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:27:55 2022] POST /identity/v3/users => generated 310 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:27:55.436809 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.449230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023cfb5-5d09-4217-aaab-301dbd85a4f0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.455257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.455873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.456143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.456482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.457126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.459196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.461943 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:55.473339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1322/2639] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:27:55.478167 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.492973 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963411a-2da2-4630-b3d5-1efd1e5f85dd admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.501887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.502948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.503231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.503623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] PATH_INFO: `/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef/users/97c5e045087a40b5b3e9cb67b809341b/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.527025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3f7d20b2ef42c1b81ef6f92607bdef, user_id=97c5e045087a40b5b3e9cb67b809341b, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.529764 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.540781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:27:55.547814 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1318/2640] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:55 2022] PUT /identity/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef/users/97c5e045087a40b5b3e9cb67b809341b/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:55.552495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.565048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e5cf4-79c6-4072-9f44-9ec528397fb6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.632107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.632777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.633064 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.633335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.634054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.635702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934c71-80b7-45f2-83e5-0b9dd03749d5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.648660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1323/2641] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:27:55.653333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.665431 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc61469-8d21-4f5a-b117-73544f751fbb admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.674034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.674829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.675249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.675632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] PATH_INFO: `/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef/users/97c5e045087a40b5b3e9cb67b809341b/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.678054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3f7d20b2ef42c1b81ef6f92607bdef, user_id=97c5e045087a40b5b3e9cb67b809341b, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.681508 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.696380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1319/2642] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:27:55 2022] PUT /identity/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef/users/97c5e045087a40b5b3e9cb67b809341b/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:27:55.714630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.715350 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.715664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.761309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] MFA Rules not processed for user `97c5e045087a40b5b3e9cb67b809341b`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:27:55.762653 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:55.848289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1324/2643] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:27:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:27:55.861013 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:55.863355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:27:55.939560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44cd0d-1b58-4275-8470-aa5eecf027b0 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:55.943762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:55.944386 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:55.944681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:55.944930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:55.956283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:55.957822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:55.969714 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1320/2644] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:27:56.156896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:27:56.172019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41eb595-8c2e-4803-9eb6-b0c7a394558b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:27:56.177200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:27:56.177847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:27:56.178126 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:27:56.178395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:27:56.255710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:27:56.257797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8474a525-7658-41eb-972b-bf8d954e8536 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:27:56.271573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1325/2645] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:27:56 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:01.804681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:01.886659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e1b2a-8364-4a32-bfdc-ded27f758da0 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:01.892004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:01.892375 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:01.892627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:01.892925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] PATH_INFO: `/v3/users/d6a40e5d38ef407e8dabdc099f95304f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:01.894206 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a40e5d38ef407e8dabdc099f95304f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:01.896141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:01.953426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a40e5d38ef407e8dabdc099f95304f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:01.964872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a40e5d38ef407e8dabdc099f95304f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:01.980502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a40e5d38ef407e8dabdc099f95304f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:01.981341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a40e5d38ef407e8dabdc099f95304f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:01.990919 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a40e5d38ef407e8dabdc099f95304f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.000231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1321/2646] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:01 2022] DELETE /identity/v3/users/d6a40e5d38ef407e8dabdc099f95304f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:02.005486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:02.006424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:02.006424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:02.038175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:02.039769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:02.053142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:02.106094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1326/2647] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:02.123096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:02.125193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:02.141790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:02.204587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ee2bf-7c9b-497c-8cbb-63b4bf940756 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:02.210109 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:02.210983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:02.211157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:02.211620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:02.223421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:02.224917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:02.237092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1322/2648] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:02.590039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:02.592030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:02.608816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d3136-4f0f-4ba1-977c-642eb6485bbd None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:02.616774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:02.618139 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:02.618529 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:02.618821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] PATH_INFO: `/v3/projects/4a9a070cf8ba4b4092700daf577542a0` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:02.620305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9a070cf8ba4b4092700daf577542a0)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:02.622688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:02.681038 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9a070cf8ba4b4092700daf577542a0', 'request_id': 'req-a1ee1780-ef18-4c0d-be74-353a98b4c652'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.686770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9a070cf8ba4b4092700daf577542a0', 'request_id': 'req-a1ee1780-ef18-4c0d-be74-353a98b4c652'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.697816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9a070cf8ba4b4092700daf577542a0', 'request_id': 'req-a1ee1780-ef18-4c0d-be74-353a98b4c652'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.712105 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] The token cache is being invalidate because project 4a9a070cf8ba4b4092700daf577542a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:02.712491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.713257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.715610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1327/2649] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:02 2022] DELETE /identity/v3/projects/4a9a070cf8ba4b4092700daf577542a0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:02.721049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:02.732119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a0cc9-c271-4eb1-9d33-554aef9c01c0 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:02.810195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:02.811180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:02.811456 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:02.811896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] PATH_INFO: `/v3/users/97c5e045087a40b5b3e9cb67b809341b` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:02.813762 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c5e045087a40b5b3e9cb67b809341b)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:02.817166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:02.881076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c5e045087a40b5b3e9cb67b809341b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.891627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c5e045087a40b5b3e9cb67b809341b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.906476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c5e045087a40b5b3e9cb67b809341b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.907286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c5e045087a40b5b3e9cb67b809341b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.915251 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-77bdb735-7db8-4ed3-b200-8e25207fd773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c5e045087a40b5b3e9cb67b809341b'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:02.925128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1323/2650] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:02 2022] DELETE /identity/v3/users/97c5e045087a40b5b3e9cb67b809341b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:03.260888 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.262574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:03.289195 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee1780-ef18-4c0d-be74-353a98b4c652 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.397650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.398326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.398603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.398877 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] PATH_INFO: `/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.400016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3f7d20b2ef42c1b81ef6f92607bdef)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.402093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.474906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:03.483988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3f7d20b2ef42c1b81ef6f92607bdef', 'request_id': 'req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:03.495037 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3f7d20b2ef42c1b81ef6f92607bdef', 'request_id': 'req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:03.503467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3f7d20b2ef42c1b81ef6f92607bdef', 'request_id': 'req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:03.521223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] The token cache is being invalidate because project bb3f7d20b2ef42c1b81ef6f92607bdef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:03.521556 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:03.522250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1fb33f6b-9bb3-493c-b935-32dd48a4e2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:03.523937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1328/2651] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:03 2022] DELETE /identity/v3/projects/bb3f7d20b2ef42c1b81ef6f92607bdef => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:03.529410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.529718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.529995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.556433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:03.559185 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:03.595366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:03.643949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1324/2652] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:03.651055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.651340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.651615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.673207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:03.674400 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:03.682608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1329/2653] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:03.689637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.699473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432d0e9-f2e3-4232-83ec-c7bc50d8a7ca None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.704540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.704945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.705224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.705560 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.706182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:03.706482 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.708084 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.720889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1325/2654] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:03.725257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.735116 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf61517-c70c-4f5b-b032-b413e8ebf185 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.740110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.740710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.740987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.741256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.741918 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.743812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.773810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1330/2655] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:03 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:03.778225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.788886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c3a3-370b-431f-b6c4-0f6bc208dfbe admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.850435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.851178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.851335 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.851605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.852262 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.854218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.877867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1326/2656] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:03 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:03.882445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.895075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bee359-8edd-437e-a4b6-091b3da19ba9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.901349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.901999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.902279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.902555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.903231 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.904881 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.916009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1331/2657] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:03.920966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.934195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34ea181-c8e7-4e3b-a985-5131cfdf15d1 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.940173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.940794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.941071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.941339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.942054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:03.943881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77842155-b339-416f-8276-3b3005ccf2d2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:03.960406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1327/2658] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:03.962065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:03.974169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60079af-7a13-4c9b-b7f1-c2ccf7034876 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:03.980266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:03.980978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:03.981248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:03.981564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] PATH_INFO: `/v3/projects/0e9cc0a7fe6b417091f99cc7ce1fac19/users/3a50a0763c40460bb48d4d04890ea2ad/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:03.998567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9cc0a7fe6b417091f99cc7ce1fac19, user_id=3a50a0763c40460bb48d4d04890ea2ad, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.001650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.017516 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1332/2659] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:03 2022] PUT /identity/v3/projects/0e9cc0a7fe6b417091f99cc7ce1fac19/users/3a50a0763c40460bb48d4d04890ea2ad/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:04.028404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.028622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.028897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.061581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] MFA Rules not processed for user `3a50a0763c40460bb48d4d04890ea2ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:04.063017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:04.132886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1328/2660] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:04.140525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.207566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafb6f5-b0c3-4701-9975-007c28a96043 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.212774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.213419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.213708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.213976 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.214607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.216504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.250206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1333/2661] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:04 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:04.254736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.266409 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9d257-dcf2-4857-99d1-44ac507a7e50 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.292402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:04.326786 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.327399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.327675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.327945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.328685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.330844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.353690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1329/2662] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:04 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:04.358169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.368717 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811eed1-2bd7-4c99-9760-a956b9372816 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.374492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.375102 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.375378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.375676 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.376480 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.378150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.389553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1334/2663] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:04.394059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.404649 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be350-a7ed-40cd-8d03-4c38be2cd28d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.410594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.411270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.411546 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.411809 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] PATH_INFO: `/v3/projects/f0c2c36b85e9455590aa214aa373492f/users/adbddb622e274a3f8a67d2d059773de1/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.427385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c2c36b85e9455590aa214aa373492f, user_id=adbddb622e274a3f8a67d2d059773de1, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.430074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.445279 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1330/2664] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:04 2022] PUT /identity/v3/projects/f0c2c36b85e9455590aa214aa373492f/users/adbddb622e274a3f8a67d2d059773de1/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:04.449691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.460354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31386d-df99-410e-93f0-ce16eca7d726 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.500406 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:04.519321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.519928 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.520201 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.520467 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.521109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.522742 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3028d-44f5-4eca-bbc7-ce0718699a57 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.533904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1335/2665] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:04.538425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.549365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b173a-1c8c-4c91-8546-da332ee41ab8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.554254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.554942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.555218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.555488 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] PATH_INFO: `/v3/projects/f0c2c36b85e9455590aa214aa373492f/users/adbddb622e274a3f8a67d2d059773de1/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.557805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0c2c36b85e9455590aa214aa373492f, user_id=adbddb622e274a3f8a67d2d059773de1, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.560423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.573378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1331/2666] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:04 2022] PUT /identity/v3/projects/f0c2c36b85e9455590aa214aa373492f/users/adbddb622e274a3f8a67d2d059773de1/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:04.646951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.647213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.647519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.677458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] MFA Rules not processed for user `adbddb622e274a3f8a67d2d059773de1`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:04.678648 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:04.768483 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1336/2667] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:04.776195 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:04.778102 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:04.847689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d37aa-2b36-4203-9a9e-86a45bc4ebdc admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:04.853099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:04.853969 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:04.854099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:04.854315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:04.864625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:04.866300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba282c-14af-43a4-8000-f31efafc3e51 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:04.877434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1332/2668] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:05.306579 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:05.374472 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8ab331-02a5-48f0-9189-58fb3a7cd719 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:05.379658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:05.380299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:05.380581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:05.380958 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] PATH_INFO: `/v3/users/3a50a0763c40460bb48d4d04890ea2ad` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:05.382086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a50a0763c40460bb48d4d04890ea2ad)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:05.384040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:05.434733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a50a0763c40460bb48d4d04890ea2ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:05.453840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a50a0763c40460bb48d4d04890ea2ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:05.454909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a50a0763c40460bb48d4d04890ea2ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:05.456626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:05.464333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a50a0763c40460bb48d4d04890ea2ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:05.464994 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a50a0763c40460bb48d4d04890ea2ad'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:05.479087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1337/2669] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:05 2022] DELETE /identity/v3/users/3a50a0763c40460bb48d4d04890ea2ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:05.484050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:05.484378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:05.484648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:05.504258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:05.505521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:05.576265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1333/2670] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:05.587358 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:05.589021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:05.657324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2517ac72-ab02-45f9-9e83-675151087b42 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:05.661875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:05.662464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:05.662736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:05.663001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:05.673887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:05.675330 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:05.685058 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1338/2671] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:05.966452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:05.968138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:05.985086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12abfe2-4e36-467d-aea0-37e76bc6bbae None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:05.993638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:05.994630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:05.995127 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:05.995610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] PATH_INFO: `/v3/projects/0e9cc0a7fe6b417091f99cc7ce1fac19` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:05.997556 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9cc0a7fe6b417091f99cc7ce1fac19)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:06.001288 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:06.031309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:06.067123 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9cc0a7fe6b417091f99cc7ce1fac19', 'request_id': 'req-7771678c-8200-4ca9-b324-59c80826f6c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.076256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9cc0a7fe6b417091f99cc7ce1fac19', 'request_id': 'req-7771678c-8200-4ca9-b324-59c80826f6c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.083841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9cc0a7fe6b417091f99cc7ce1fac19', 'request_id': 'req-7771678c-8200-4ca9-b324-59c80826f6c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.094824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] The token cache is being invalidate because project 0e9cc0a7fe6b417091f99cc7ce1fac19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:06.095000 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.095660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.097173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1334/2672] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:05 2022] DELETE /identity/v3/projects/0e9cc0a7fe6b417091f99cc7ce1fac19 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:06.101413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:06.111558 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963cc26-4809-4ecc-8918-b9f219e96f3f service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:06.178474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:06.179143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:06.179515 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:06.179668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] PATH_INFO: `/v3/users/adbddb622e274a3f8a67d2d059773de1` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:06.180788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbddb622e274a3f8a67d2d059773de1)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:06.182839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:06.238965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbddb622e274a3f8a67d2d059773de1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.254142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbddb622e274a3f8a67d2d059773de1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.255109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbddb622e274a3f8a67d2d059773de1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.263269 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbddb622e274a3f8a67d2d059773de1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.264260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7bf43805-1481-4d9e-a887-62f789e66528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbddb622e274a3f8a67d2d059773de1'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.277544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1339/2673] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:06 2022] DELETE /identity/v3/users/adbddb622e274a3f8a67d2d059773de1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:06.645133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:06.646612 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:06.665318 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771678c-8200-4ca9-b324-59c80826f6c8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:06.731324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:06.732252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:06.732530 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:06.732805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] PATH_INFO: `/v3/projects/f0c2c36b85e9455590aa214aa373492f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:06.734030 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0c2c36b85e9455590aa214aa373492f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:06.736047 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:06.783807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0c2c36b85e9455590aa214aa373492f', 'request_id': 'req-20cc34c5-66d1-4f08-9c43-992b39811433'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.792999 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0c2c36b85e9455590aa214aa373492f', 'request_id': 'req-20cc34c5-66d1-4f08-9c43-992b39811433'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.800823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0c2c36b85e9455590aa214aa373492f', 'request_id': 'req-20cc34c5-66d1-4f08-9c43-992b39811433'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.811439 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] The token cache is being invalidate because project f0c2c36b85e9455590aa214aa373492f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:06.811752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.812438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-20cc34c5-66d1-4f08-9c43-992b39811433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:06.814182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1335/2674] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:06 2022] DELETE /identity/v3/projects/f0c2c36b85e9455590aa214aa373492f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:06.819367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:06.819859 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:06.819957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:06.830432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:06.846984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:06.848655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:06.915820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1340/2675] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:06.925054 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:06.925485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:06.925693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:06.946417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:06.947660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:06.955997 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1336/2676] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:06.960683 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:06.977813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e3abb8-fa2c-4df3-957b-5d0ff90e109d None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:06.986117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:06.986741 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:06.987018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:06.987284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:06.987940 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:06.988268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:06.989907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.007658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1341/2677] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:07.012066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.022285 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6b6e4-e807-4837-b4bd-7a6f16847fdc None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.027729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.028338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.028614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.028893 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.029586 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.031490 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.062213 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1337/2678] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:07 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:07.066385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.076953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd1c3-3070-4da3-b0f5-01bc7c0aa358 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.133891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.134491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.134989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.135218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.135869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.137827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.161408 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1342/2679] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:07 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:07.165694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.176688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa380dc-a570-41ff-acd6-e91603056117 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.182410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.183314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.183606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.183882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.184544 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.186193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.187713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:07.202868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1338/2680] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:07.203993 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.214626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2bb54e-494a-43c5-9f15-9185c687cee3 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.219840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.220447 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.220719 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.220985 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.221630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.223240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bb91d-1da8-44fa-ad24-5a3247c75fae admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.234459 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1343/2681] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:07.238820 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.249204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77392b-e10d-4842-8c9f-5b7a948f6382 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.254177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.254848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.255133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.255434 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] PATH_INFO: `/v3/projects/712b68435aa842fb992045d4275d0fc1/users/64e64f78c702465eb5121dd25a8c713f/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.270895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712b68435aa842fb992045d4275d0fc1, user_id=64e64f78c702465eb5121dd25a8c713f, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.273615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.288184 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1339/2682] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:07 2022] PUT /identity/v3/projects/712b68435aa842fb992045d4275d0fc1/users/64e64f78c702465eb5121dd25a8c713f/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:07.298734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.299072 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.299363 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.328132 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] MFA Rules not processed for user `64e64f78c702465eb5121dd25a8c713f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:07.329362 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:07.391890 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:07.396159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1344/2683] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:07.407992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:07.409986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:07.468056 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ce4bc-2906-42d0-957c-3182a61289f2 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:07.472116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:07.472735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:07.473070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:07.473350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:07.482925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:07.484373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6a8fa-d8f2-4324-920d-7e9a17c03e86 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:07.493661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1340/2684] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:12.058974 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:12.060493 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:12.136848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd875-41d4-4682-b339-3693d10438e2 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:12.143300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:12.144067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:12.144341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:12.144688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] PATH_INFO: `/v3/users/66d328f63a114b05b18bd160ccb78149` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:12.146032 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d328f63a114b05b18bd160ccb78149)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:12.147980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:12.202218 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d328f63a114b05b18bd160ccb78149'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.215577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d328f63a114b05b18bd160ccb78149'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.216338 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d328f63a114b05b18bd160ccb78149'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.226147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d328f63a114b05b18bd160ccb78149'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.226792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d328f63a114b05b18bd160ccb78149'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.240234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1345/2685] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:12 2022] DELETE /identity/v3/users/66d328f63a114b05b18bd160ccb78149 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:12.244902 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:12.245387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:12.245526 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:12.265339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:12.266953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:12.331785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1341/2686] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:12.341721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:12.343215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:12.402651 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7575-91b6-4ecc-a9a8-4661cae9717f admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:12.406686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:12.407395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:12.407673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:12.407944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:12.417255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:12.418734 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:12.428956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1346/2687] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:12.730944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:12.732396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:12.747404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7774c67-d6dd-47b7-bb5d-2941a6201ec8 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:12.752469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:12.753122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:12.753425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:12.753712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] PATH_INFO: `/v3/projects/7378f53ca3e447838ec392efa6c56a5a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:12.754903 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7378f53ca3e447838ec392efa6c56a5a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:12.756806 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:12.812849 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7378f53ca3e447838ec392efa6c56a5a', 'request_id': 'req-6c54fbc8-01f3-4f98-9e29-439512643b50'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.830471 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7378f53ca3e447838ec392efa6c56a5a', 'request_id': 'req-6c54fbc8-01f3-4f98-9e29-439512643b50'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.838535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7378f53ca3e447838ec392efa6c56a5a', 'request_id': 'req-6c54fbc8-01f3-4f98-9e29-439512643b50'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.847609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:12.853290 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] The token cache is being invalidate because project 7378f53ca3e447838ec392efa6c56a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:12.853982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.855062 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:12.857115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1342/2688] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:12 2022] DELETE /identity/v3/projects/7378f53ca3e447838ec392efa6c56a5a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:12.861318 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:12.873646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173daa0f-23d9-4214-aa68-055a4c25d482 service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:12.909973 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:12.970204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:12.970875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:12.971186 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:12.971471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] PATH_INFO: `/v3/users/3cdf57a7fdcd429f8e12af072993313b` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:12.972650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdf57a7fdcd429f8e12af072993313b)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:12.975573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.026901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdf57a7fdcd429f8e12af072993313b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.039448 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdf57a7fdcd429f8e12af072993313b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.040320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdf57a7fdcd429f8e12af072993313b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.048701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdf57a7fdcd429f8e12af072993313b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.049325 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-be0b9838-60df-4599-a64b-78c6e7eaaee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdf57a7fdcd429f8e12af072993313b'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.062047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1347/2689] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:12 2022] DELETE /identity/v3/users/3cdf57a7fdcd429f8e12af072993313b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:13.354660 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.356113 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:13.370264 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54fbc8-01f3-4f98-9e29-439512643b50 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.430723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.431269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.431550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.431822 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] PATH_INFO: `/v3/projects/6901dc9ed68b4ab49e542158baab23bf` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.433060 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6901dc9ed68b4ab49e542158baab23bf)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.435018 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.484313 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6901dc9ed68b4ab49e542158baab23bf', 'request_id': 'req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.493353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6901dc9ed68b4ab49e542158baab23bf', 'request_id': 'req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.500147 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6901dc9ed68b4ab49e542158baab23bf', 'request_id': 'req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.511962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] The token cache is being invalidate because project 6901dc9ed68b4ab49e542158baab23bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:13.512208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.512950 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-5b61bae4-5a34-47ad-83d0-5b33d4fbd463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:13.514879 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1343/2690] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:13 2022] DELETE /identity/v3/projects/6901dc9ed68b4ab49e542158baab23bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:13.520145 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.520428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.520701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.541723 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:13.542953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:13.611212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1348/2691] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:13.620292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.620604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.620876 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.647374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:13.648605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:13.657301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1344/2692] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:13.661838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.672060 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169e494-f9f2-42e7-a61a-0915e2ffecb5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.677498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.678111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.678392 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.678659 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.679305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:13.679607 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.681284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.694590 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1349/2693] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:13.699327 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.709055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e212700-9104-4cde-8869-097b31a734f4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.713900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.714515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.714777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.715049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.715818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.717770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.749883 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1345/2694] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:13.754255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.765587 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0dd7a3-3e4d-46f8-9ae7-b19336c55313 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.797022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:13.835192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.835192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.835192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.835192 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.836284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.836284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.859260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1350/2695] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:13 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:13.863596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.874315 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64384092-12ec-4f9c-9bdd-75760e301f9e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.880474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.881291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.881638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.881915 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.882578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.884227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.896059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1346/2696] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:13.900971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.912959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac19b1-baf9-485c-8dae-166098adeb78 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.918119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.919055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.919502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.919868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.920840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.923343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c002a-a601-415f-a173-04d65634736e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.943606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1351/2697] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:13.943800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:13.954161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7833edb-555c-4cf3-b64e-1774efa07b43 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:13.959180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:13.960221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:13.960221 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:13.960452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] PATH_INFO: `/v3/projects/db467397ed7d41898eaf34269a08a78b/users/4ec0b3c5d5ff44ae981a18a53521fffc/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:13.977600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db467397ed7d41898eaf34269a08a78b, user_id=4ec0b3c5d5ff44ae981a18a53521fffc, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:13.980257 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:13.994694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1347/2698] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:13 2022] PUT /identity/v3/projects/db467397ed7d41898eaf34269a08a78b/users/4ec0b3c5d5ff44ae981a18a53521fffc/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:14.005782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.006062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.006397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.049461 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] MFA Rules not processed for user `4ec0b3c5d5ff44ae981a18a53521fffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:14.050707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:14.131411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1352/2699] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:14.134212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.163523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:14.218937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d746b9d-edb6-47f2-9136-a4b9ec17760a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.224451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.225085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.225366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.225673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.226341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.228270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.256590 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1348/2700] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:14 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:14.260159 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.271927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e434cd5-71ee-4df8-aa08-8b2575647e3a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.333500 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.334122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.334423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.334690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.335340 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.337280 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.360140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1353/2701] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:14 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:14.364266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.374865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ec5da-64d8-44d1-93b0-0efcf348e2a8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.379487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.380092 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.380372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.380643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.381298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.382932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.394073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1349/2702] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:14.398456 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.408880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e0cff-66dc-40ea-8e18-c1c044f45fd4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.414577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.415235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.415513 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.415784 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] PATH_INFO: `/v3/projects/c6c0c52f4d5945418c211115ca64febf/users/e0f29f9cca8546c5a48d6e9d6bfa1d48/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.432376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c0c52f4d5945418c211115ca64febf, user_id=e0f29f9cca8546c5a48d6e9d6bfa1d48, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.435166 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.450143 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1354/2703] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:14 2022] PUT /identity/v3/projects/c6c0c52f4d5945418c211115ca64febf/users/e0f29f9cca8546c5a48d6e9d6bfa1d48/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:14.454278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.465087 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7203-367e-41cd-b6f0-96a916050b37 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.522006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.522616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.522925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.523201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.523847 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.525503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aae8f8-9ca1-4507-8781-83fc31b68f16 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.535990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1350/2704] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:14.540368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.545966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:14.552843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5095e2e-ea45-4087-b097-881fbff4041d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.558187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.558865 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.559137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.559405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] PATH_INFO: `/v3/projects/c6c0c52f4d5945418c211115ca64febf/users/e0f29f9cca8546c5a48d6e9d6bfa1d48/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.561834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c0c52f4d5945418c211115ca64febf, user_id=e0f29f9cca8546c5a48d6e9d6bfa1d48, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.564684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.578154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1355/2705] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:14 2022] PUT /identity/v3/projects/c6c0c52f4d5945418c211115ca64febf/users/e0f29f9cca8546c5a48d6e9d6bfa1d48/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:14.589831 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.590118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.590390 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.619614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] MFA Rules not processed for user `e0f29f9cca8546c5a48d6e9d6bfa1d48`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:14.620894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:14.692652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1351/2706] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:14.705176 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.707025 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:14.767006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6c112-1b4e-4ba6-8be6-9a75c6562234 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.771031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.771631 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.771909 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.772175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.781451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.782970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.792718 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1356/2707] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:14.867977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:14.878674 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f0d76-a0ec-4170-9c51-30ddfe8bec6f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:14.882716 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:14.883339 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:14.883622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:14.883956 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:14.902137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:14.944776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:14.946269 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:14.956156 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1352/2708] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:15.083233 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:15.084934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:15.156560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974852-8944-48d8-ba0f-ee366ca8b74e service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:15.160634 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:15.161851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:15.162127 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:15.162393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:15.164155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:15.236253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:15.237691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fcd5f-9624-4c5d-80f3-cc8f1c009190 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:15.241480 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:15.252819 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd43e3-278f-4d80-bded-14c23e75fe76 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:15.255764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1357/2709] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:15.258624 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:15.259331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:15.259615 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:15.260040 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] PATH_INFO: `/v3/users/4ec0b3c5d5ff44ae981a18a53521fffc` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:15.261447 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec0b3c5d5ff44ae981a18a53521fffc)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:15.263982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:15.330650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec0b3c5d5ff44ae981a18a53521fffc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:15.341884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec0b3c5d5ff44ae981a18a53521fffc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:15.359848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec0b3c5d5ff44ae981a18a53521fffc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:15.361550 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec0b3c5d5ff44ae981a18a53521fffc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:15.372133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec0b3c5d5ff44ae981a18a53521fffc'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:15.379380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1353/2710] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:15 2022] DELETE /identity/v3/users/4ec0b3c5d5ff44ae981a18a53521fffc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:15.383998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:15.384328 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:15.384608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:15.405497 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:15.406716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:15.448073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:15.472435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1358/2711] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:15.482438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:15.484045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:15.552792 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb656-a96b-424f-8c8b-059520634769 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:15.569682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:15.569682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:15.569682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:15.569682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:15.582559 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:15.584089 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:15.595589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1354/2712] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:16.283654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:16.285332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:16.297891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294c49-60ad-4c84-9353-d4e26859aefc None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:16.303745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:16.304432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:16.304705 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:16.305005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] PATH_INFO: `/v3/projects/db467397ed7d41898eaf34269a08a78b` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:16.306193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db467397ed7d41898eaf34269a08a78b)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:16.308222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:16.361892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db467397ed7d41898eaf34269a08a78b', 'request_id': 'req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.368578 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db467397ed7d41898eaf34269a08a78b', 'request_id': 'req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.376656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db467397ed7d41898eaf34269a08a78b', 'request_id': 'req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.396745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] The token cache is being invalidate because project db467397ed7d41898eaf34269a08a78b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:16.397205 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.398296 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.400880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1359/2713] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:16 2022] DELETE /identity/v3/projects/db467397ed7d41898eaf34269a08a78b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:16.405119 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:16.415751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5106e2-7dd6-440f-a977-8ed2ab88e056 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:16.448025 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:16.479145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:16.479789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:16.480073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:16.480350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] PATH_INFO: `/v3/users/e0f29f9cca8546c5a48d6e9d6bfa1d48` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:16.481551 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f29f9cca8546c5a48d6e9d6bfa1d48)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:16.483484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:16.539976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f29f9cca8546c5a48d6e9d6bfa1d48'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.556440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f29f9cca8546c5a48d6e9d6bfa1d48'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.576224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f29f9cca8546c5a48d6e9d6bfa1d48'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.577205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f29f9cca8546c5a48d6e9d6bfa1d48'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.586652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-e54fd488-c022-4ec0-9c54-6de5210527fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f29f9cca8546c5a48d6e9d6bfa1d48'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:16.596090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1355/2714] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:16 2022] DELETE /identity/v3/users/e0f29f9cca8546c5a48d6e9d6bfa1d48 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:17.114341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.116679 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:17.137498 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545448d-6ca4-4f51-9a46-cb4ea6ec4a94 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.204745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.205571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.206070 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.206410 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] PATH_INFO: `/v3/projects/c6c0c52f4d5945418c211115ca64febf` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.207699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c0c52f4d5945418c211115ca64febf)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.209998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.280647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c0c52f4d5945418c211115ca64febf', 'request_id': 'req-d51da297-a3ec-4e0e-8198-7646da1a51ca'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:17.288910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c0c52f4d5945418c211115ca64febf', 'request_id': 'req-d51da297-a3ec-4e0e-8198-7646da1a51ca'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:17.299428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c0c52f4d5945418c211115ca64febf', 'request_id': 'req-d51da297-a3ec-4e0e-8198-7646da1a51ca'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:17.319283 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:17.331980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] The token cache is being invalidate because project c6c0c52f4d5945418c211115ca64febf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:17.332551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:17.334425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d51da297-a3ec-4e0e-8198-7646da1a51ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:17.336339 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1360/2715] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:17 2022] DELETE /identity/v3/projects/c6c0c52f4d5945418c211115ca64febf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:17.342137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.342137 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.342382 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.369165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:17.370682 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:17.455575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1356/2716] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:17.463191 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.463750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.464112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.488008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:17.489526 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:17.497787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1361/2717] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:17.502890 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.518114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92d611-89cb-4576-9989-0d3c26ba9259 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.523399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.524372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.525079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.525611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.526505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:17.527073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.529361 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.546207 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1357/2718] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:17.550574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.563738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99304c-2eb0-415a-bb29-5ce255e1711c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.570085 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.570789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.571112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.571385 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.572051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.574222 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.606768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1362/2719] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:17 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:17.611862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.626003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803393b1-b3bd-48a6-a8b9-c642118f8047 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.673248 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:17.711730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.712576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.713771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.713771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.713771 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.721892 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.766362 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1358/2720] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:17 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:17.767962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.778821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5254a-a5bb-4525-9d6c-09b7c4428efd admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.785254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.786053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.786891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.786891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.787390 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.789134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.803907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1363/2721] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:17.812611 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.823475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e97245-7aa3-441b-83f3-895c308067f5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.828217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.828872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.829145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.829479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.830096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.831706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc97be1-837d-400a-82a0-ee3306654f5a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.842767 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1359/2722] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:17.847864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:17.858658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dd18-e67b-4b47-9c5e-2af13b8fb25d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:17.863537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:17.864193 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.864470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.864739 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] PATH_INFO: `/v3/projects/26b63fd377d84e3097de168de78c3d7c/users/badf1ed60a1d4b14ac3832d3a5caac88/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.881004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b63fd377d84e3097de168de78c3d7c, user_id=badf1ed60a1d4b14ac3832d3a5caac88, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:17.883910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:17.898528 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1364/2723] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:17 2022] PUT /identity/v3/projects/26b63fd377d84e3097de168de78c3d7c/users/badf1ed60a1d4b14ac3832d3a5caac88/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:17.909574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:17.909574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:17.909839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:17.943020 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] MFA Rules not processed for user `badf1ed60a1d4b14ac3832d3a5caac88`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:17.944244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:18.016078 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1360/2724] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:18.020923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.099594 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e58-96e2-4e5d-891c-28eea3e768e4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.111454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.111454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.111454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.111454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.111830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.112984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.150621 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1365/2725] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:18 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:18.155073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.181777 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e296ab4a-a7e3-4cdb-bc38-7dbc688a0080 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.245498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.246161 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.246435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.246704 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.247470 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.249965 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.283205 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1361/2726] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:18 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:18.284433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.295066 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce29968-ee62-489a-8768-f4d48d0ee757 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.299929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.300872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.300872 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.301155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.301714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.303368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.317573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1366/2727] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:18.321898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.333642 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd2ed1-9e6f-4437-a9b7-4c72c85a8f4f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.338515 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.339253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.339534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.339811 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] PATH_INFO: `/v3/projects/ef1b960ca17c4f5eb59964146a230c79/users/755207491b7d484faa45cb90c96b35f8/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.359454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1b960ca17c4f5eb59964146a230c79, user_id=755207491b7d484faa45cb90c96b35f8, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.362410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.380297 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1362/2728] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:18 2022] PUT /identity/v3/projects/ef1b960ca17c4f5eb59964146a230c79/users/755207491b7d484faa45cb90c96b35f8/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:18.384863 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.401356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4e87d4-0a92-441b-a09e-361dd989cbd9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.468302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.468904 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.469254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.469616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.470349 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.472317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ffe1a-2b50-4b1d-8177-a756b8f57a9a admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.484469 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1367/2729] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:18.489442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.505024 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b03ac3-d677-4b15-b651-eccbc75bf4da admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.515287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.516006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.516446 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.516727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] PATH_INFO: `/v3/projects/ef1b960ca17c4f5eb59964146a230c79/users/755207491b7d484faa45cb90c96b35f8/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.518761 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1b960ca17c4f5eb59964146a230c79, user_id=755207491b7d484faa45cb90c96b35f8, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.521535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.530881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:18.541854 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1363/2730] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:18 2022] PUT /identity/v3/projects/ef1b960ca17c4f5eb59964146a230c79/users/755207491b7d484faa45cb90c96b35f8/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:18.554154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.554478 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.554757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.565432 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:18.626777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] MFA Rules not processed for user `755207491b7d484faa45cb90c96b35f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:18.629657 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:18.751665 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1368/2731] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:18.774105 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:18.775977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:18.873627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ecd-ae04-4e65-9d79-1bb84766ffc7 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:18.878220 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:18.878881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:18.879160 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:18.879622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:18.979867 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:18.981410 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:18.994236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1364/2732] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:19.093661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.093661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.190998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d9d05-a3c6-43d3-b375-628820662242 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.197379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.198056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.198776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.199034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] PATH_INFO: `/v3/users/cd08f3b52004476b9eb532c7c68ab679` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.200197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd08f3b52004476b9eb532c7c68ab679)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.202952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.271229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd08f3b52004476b9eb532c7c68ab679'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.290474 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd08f3b52004476b9eb532c7c68ab679'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.291530 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd08f3b52004476b9eb532c7c68ab679'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.301926 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd08f3b52004476b9eb532c7c68ab679'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.302686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd08f3b52004476b9eb532c7c68ab679'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.323481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1369/2733] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:19 2022] DELETE /identity/v3/users/cd08f3b52004476b9eb532c7c68ab679 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:19.336341 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.339057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.355648 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517367a5-7a90-428a-941b-63e99596500a service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.449145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.449868 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.450693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.450693 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] PATH_INFO: `/v3/users/64e64f78c702465eb5121dd25a8c713f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.452340 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e64f78c702465eb5121dd25a8c713f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.454561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.537023 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e64f78c702465eb5121dd25a8c713f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.550738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.553056 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.556694 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e64f78c702465eb5121dd25a8c713f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.561629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:19.585734 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e64f78c702465eb5121dd25a8c713f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.585987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fc211-c8b2-4db9-8043-c3cab3740c4d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.586654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e64f78c702465eb5121dd25a8c713f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.592327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.593107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.593527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.593789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] PATH_INFO: `/v3/projects/9409824440cb45508754064b55438edd` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.595180 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9409824440cb45508754064b55438edd)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.596698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f103dde9-9c6c-4ae4-9019-6164c430980f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e64f78c702465eb5121dd25a8c713f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.597239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.604610 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1365/2734] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:19 2022] DELETE /identity/v3/users/64e64f78c702465eb5121dd25a8c713f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:19.609017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:19.610212 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.610562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.610926 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.630884 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:19.632139 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.666893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9409824440cb45508754064b55438edd', 'request_id': 'req-3245126f-94dd-4a93-80e4-ec8413a7b7d3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.673989 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9409824440cb45508754064b55438edd', 'request_id': 'req-3245126f-94dd-4a93-80e4-ec8413a7b7d3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.681301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9409824440cb45508754064b55438edd', 'request_id': 'req-3245126f-94dd-4a93-80e4-ec8413a7b7d3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.696615 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] The token cache is being invalidate because project 9409824440cb45508754064b55438edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:19.696919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.697667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-3245126f-94dd-4a93-80e4-ec8413a7b7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:19.699781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1370/2735] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:19 2022] DELETE /identity/v3/projects/9409824440cb45508754064b55438edd => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:19.704792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd86a-26b8-4726-975b-bd7376392b43 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.705173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd86a-26b8-4726-975b-bd7376392b43 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.705332 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fd86a-26b8-4726-975b-bd7376392b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.712076 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1366/2736] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:19.720045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.721483 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.728819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-409fd86a-26b8-4726-975b-bd7376392b43 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:19.730341 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-409fd86a-26b8-4726-975b-bd7376392b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.793517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe7355-5266-499a-9ad4-86267b5ec91f None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.808873 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1371/2737] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:19.818796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.819075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.819387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.842144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:19.844466 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:19.854425 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1372/2738] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:19.859285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.866378 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.867125 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.867408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.867691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.869449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d3dd7-ba23-4ca8-b65f-efb562de40f9 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.874915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.875572 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.875849 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.876122 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.876774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:19.877230 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.878330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.878830 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.879962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.893334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1373/2739] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:28:19.897198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1367/2740] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:19.901033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.912916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896d6f-ce3f-4999-b4ff-c761af3d8839 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.917786 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:19.918511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:19.918754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:19.919088 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:19.919919 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:19.922011 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:19.953259 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1374/2741] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:19 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:19.957727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:19.968096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197198a-d17c-41a5-a10a-4e9ce3187906 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:19.999967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.028945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.029504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.029801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.030053 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.030707 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.032853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.059738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1368/2742] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:19 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:20.061156 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.075307 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32c2ff-8408-4b9e-8004-ac03af6655aa admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.081087 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.081773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.082045 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.082308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.084378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.090800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.118416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1375/2743] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:20.122698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.133874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57467-d764-4abc-9b30-95d23baa11cb admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.139249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.139875 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.140154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.140427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.141079 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.142784 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.154067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1369/2744] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:20.158666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.168798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b1902-8b56-4206-b838-71f57021262b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.174569 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.175251 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.175668 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.175945 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] PATH_INFO: `/v3/projects/2c589386dfe1410fad77ccc39c8de8a9/users/2de0034a139f4e5e99ad7875321cc36d/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.195872 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.196287 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c589386dfe1410fad77ccc39c8de8a9, user_id=2de0034a139f4e5e99ad7875321cc36d, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.198334 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.199726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d56f07-387b-4cda-87a6-162492d7ad29 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.216698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1376/2745] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:20 2022] PUT /identity/v3/projects/2c589386dfe1410fad77ccc39c8de8a9/users/2de0034a139f4e5e99ad7875321cc36d/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:20.224312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378fcde-2370-4261-83da-487bd7176b58 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.229273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.229598 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.229880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.256633 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.260776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] MFA Rules not processed for user `2de0034a139f4e5e99ad7875321cc36d`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:20.262640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.294413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.294988 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.295275 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.295548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] PATH_INFO: `/v3/projects/712b68435aa842fb992045d4275d0fc1` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.296708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712b68435aa842fb992045d4275d0fc1)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.298698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.333596 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1377/2746] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:20.338255 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.348955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb30b-b686-4c32-a72c-cb387f567c01 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.350589 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712b68435aa842fb992045d4275d0fc1', 'request_id': 'req-f5539a5a-9402-446c-8d30-e972c7a72e69'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:20.358552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712b68435aa842fb992045d4275d0fc1', 'request_id': 'req-f5539a5a-9402-446c-8d30-e972c7a72e69'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:20.365202 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712b68435aa842fb992045d4275d0fc1', 'request_id': 'req-f5539a5a-9402-446c-8d30-e972c7a72e69'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:20.376216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] The token cache is being invalidate because project 712b68435aa842fb992045d4275d0fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:20.376584 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:20.377252 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f5539a5a-9402-446c-8d30-e972c7a72e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:20.379201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1370/2747] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:20 2022] DELETE /identity/v3/projects/712b68435aa842fb992045d4275d0fc1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:20.384005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddc820-971c-4f54-83ee-b5461ff4beaf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.384293 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddc820-971c-4f54-83ee-b5461ff4beaf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.384572 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ddc820-971c-4f54-83ee-b5461ff4beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.404653 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-25ddc820-971c-4f54-83ee-b5461ff4beaf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:20.405896 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-25ddc820-971c-4f54-83ee-b5461ff4beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.409537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.410149 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.410420 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.410688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.411322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.413239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.415052 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1371/2748] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:20.424374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.425015 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.425425 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.441628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1378/2749] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:20.445764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.447487 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.449918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:20.451114 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.484935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.518744 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1372/2750] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:20.522756 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c13cf-d7a1-4b54-a74b-761ca7ff0fa2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.526421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.529370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.530264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.530638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.531028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.531991 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.534680 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.536652 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024392-5e2b-4291-8471-89a49d1dee65 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.541846 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.542673 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.542949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.543309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.544066 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:20.544659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.546271 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.559827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1379/2751] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:20.563863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1373/2752] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:28:20.565243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.569718 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.579148 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816130e5-3a2e-4480-95fb-336e88679bca admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.583725 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8b3d6-ed1f-4123-9e5c-b06c23b651e4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.584733 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.585351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.585709 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.585977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.586617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.588214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.589499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.590121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.590406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.590817 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.591476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.593623 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.600757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1380/2753] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:20.605934 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.621892 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5965f5-78d5-4674-9a0a-4f2d515d790b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.628735 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.629512 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.629792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.630079 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] PATH_INFO: `/v3/projects/02d95ae65c2045078a2d59a77a688217/users/b8fed5126a0b4b3bb556f2e545a32b3d/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.632664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.637940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1374/2754] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:20.639268 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.649750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d95ae65c2045078a2d59a77a688217, user_id=b8fed5126a0b4b3bb556f2e545a32b3d, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.653379 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.672562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1381/2755] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:20 2022] PUT /identity/v3/projects/02d95ae65c2045078a2d59a77a688217/users/b8fed5126a0b4b3bb556f2e545a32b3d/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:20.678819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.731931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50b298-b99a-413f-afdc-1b40384ebe66 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.762760 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f2cad-b55f-4e5d-a3b0-7201b39d107e admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.768574 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.769612 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.770081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.770356 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.771018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.772706 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.783808 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1382/2756] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:20.788473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.800575 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.801073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd33f6-4f95-4f84-96a6-3233806a3630 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.801596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.801596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.801983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.802727 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.804928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998314f-f795-4cfa-acab-4aaac77be226 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.807524 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.808333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.808616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.808891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] PATH_INFO: `/v3/projects/02d95ae65c2045078a2d59a77a688217/users/b8fed5126a0b4b3bb556f2e545a32b3d/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.811140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02d95ae65c2045078a2d59a77a688217, user_id=b8fed5126a0b4b3bb556f2e545a32b3d, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.813963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.826234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1383/2757] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:20 2022] PUT /identity/v3/projects/02d95ae65c2045078a2d59a77a688217/users/b8fed5126a0b4b3bb556f2e545a32b3d/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:20.837438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1375/2758] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:20.842660 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.844684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.845112 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.845461 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.903443 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] MFA Rules not processed for user `b8fed5126a0b4b3bb556f2e545a32b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:20.904759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:20.936975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b68bcc-3253-4389-a1e7-da2ed60aa4d4 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.944168 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.945152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.945470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.947342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:20.953712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:20.956620 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:20.959210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:20.975154 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1384/2759] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:20.980290 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:20.992545 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a6102-1873-4a28-aa6c-8a3107244fdb admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:20.998623 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:20.999397 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:20.999584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:20.999854 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.000840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:21.002730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:21.016921 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1385/2760] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:21.021944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:21.035523 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd5c6a-891e-48c5-9020-f17e58555540 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:21.043686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1376/2761] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:21.045316 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:21.046041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:21.046320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:21.046869 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] PATH_INFO: `/v3/projects/5be372d7f60f4857a0a0f1bb41895318/users/d825e2a7854d4e048d3c9db6d29eb8fb/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.052244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:21.054037 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:21.065724 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be372d7f60f4857a0a0f1bb41895318, user_id=d825e2a7854d4e048d3c9db6d29eb8fb, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:21.068393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee722d-87fb-4e71-b234-5eaf8f89330e admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:21.083404 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1386/2762] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:21 2022] PUT /identity/v3/projects/5be372d7f60f4857a0a0f1bb41895318/users/d825e2a7854d4e048d3c9db6d29eb8fb/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:21.094475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:21.094806 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:21.095234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.115210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9823b2c-8405-4121-bdb0-f967f332c23c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:21.127608 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] MFA Rules not processed for user `d825e2a7854d4e048d3c9db6d29eb8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:21.128938 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:21.143336 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:21.170578 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:21.171188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:21.171465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:21.171731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.203335 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1387/2763] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:21.217155 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:21.218848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:21.231678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7f487-d871-4338-afec-6dbe770a05b4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:21.236333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:21.236956 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:21.237240 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:21.237543 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.245827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:21.246504 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:21.247316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:21.247949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:21.257596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1377/2764] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:21.257851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1388/2765] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:21.349569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:21.358992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c17199-7b72-4015-abb3-d94a1b3aa4dc service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:21.363523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:21.364165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:21.364500 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:21.364891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:21.366689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:21.398231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:21.436406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:21.438305 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:21.450010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1378/2766] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:23.592661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:23.603977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95596ada-3691-41b7-97d8-fe5074f675f8 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:23.608463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:23.609377 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:23.609686 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:23.610017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:23.611915 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:23.690049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:23.691577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6741ff-d73c-485d-a97c-714cce437d85 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:23.703520 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1389/2767] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:23.905963 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:23.996672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c009-aa50-41e6-b6c7-3ed8198c8d31 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:24.011844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:24.012949 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:24.013333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:24.014117 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] PATH_INFO: `/v3/users/d825e2a7854d4e048d3c9db6d29eb8fb` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:24.016120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d825e2a7854d4e048d3c9db6d29eb8fb)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:24.019587 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:24.092099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd825e2a7854d4e048d3c9db6d29eb8fb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.104002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd825e2a7854d4e048d3c9db6d29eb8fb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.134726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd825e2a7854d4e048d3c9db6d29eb8fb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.136838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd825e2a7854d4e048d3c9db6d29eb8fb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.153651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd825e2a7854d4e048d3c9db6d29eb8fb'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.165516 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1379/2768] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:23 2022] DELETE /identity/v3/users/d825e2a7854d4e048d3c9db6d29eb8fb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:24.168206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:24.168667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:24.169121 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:24.196348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:24.197814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:24.277005 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1390/2769] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:24.291246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:24.292775 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:24.361021 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:24.368821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa5b8f-8f19-45eb-8abf-27f9eb30f11b admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:24.376505 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:24.377493 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:24.377961 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:24.378450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:24.396170 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:24.398723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:24.417256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1380/2770] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:24.744703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:24.746798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:24.764862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc334c77-34c6-48b3-8db3-8a86b1adb29a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:24.771074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:24.771939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:24.772352 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:24.772740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] PATH_INFO: `/v3/projects/5be372d7f60f4857a0a0f1bb41895318` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:24.774111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be372d7f60f4857a0a0f1bb41895318)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:24.776405 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:24.945242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:24.967260 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be372d7f60f4857a0a0f1bb41895318', 'request_id': 'req-ad72e95b-1d16-44d2-844c-2b48c9a667be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.975213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be372d7f60f4857a0a0f1bb41895318', 'request_id': 'req-ad72e95b-1d16-44d2-844c-2b48c9a667be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:24.987361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be372d7f60f4857a0a0f1bb41895318', 'request_id': 'req-ad72e95b-1d16-44d2-844c-2b48c9a667be'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:25.004930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] The token cache is being invalidate because project 5be372d7f60f4857a0a0f1bb41895318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:25.005462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:25.006160 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-ad72e95b-1d16-44d2-844c-2b48c9a667be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:25.007801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1391/2771] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:24 2022] DELETE /identity/v3/projects/5be372d7f60f4857a0a0f1bb41895318 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:28.617235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:28.619165 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:28.635266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a44666-a6d1-411f-a80a-7bcab2867f48 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:28.705381 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:28.706116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:28.706399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:28.706700 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] PATH_INFO: `/v3/users/2de0034a139f4e5e99ad7875321cc36d` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:28.707877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de0034a139f4e5e99ad7875321cc36d)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:28.710503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:28.771115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de0034a139f4e5e99ad7875321cc36d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:28.779218 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de0034a139f4e5e99ad7875321cc36d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:28.791984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de0034a139f4e5e99ad7875321cc36d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:28.792706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de0034a139f4e5e99ad7875321cc36d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:28.799886 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de0034a139f4e5e99ad7875321cc36d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:28.806010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1381/2772] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:28 2022] DELETE /identity/v3/users/2de0034a139f4e5e99ad7875321cc36d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:28.811264 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d576af-4334-459b-bc20-c16e6297980c None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:28.811696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d576af-4334-459b-bc20-c16e6297980c None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:28.811799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d576af-4334-459b-bc20-c16e6297980c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:28.833494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:28.833837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-50d576af-4334-459b-bc20-c16e6297980c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:28.835059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-50d576af-4334-459b-bc20-c16e6297980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:28.835596 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:28.912531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3630aab-d8cc-4152-9590-0160593c17e9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:28.919487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:28.920289 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:28.920547 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:28.920877 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] PATH_INFO: `/v3/users/badf1ed60a1d4b14ac3832d3a5caac88` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:28.922555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=badf1ed60a1d4b14ac3832d3a5caac88)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:28.924437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:28.933485 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1392/2773] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:28.937594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:28.945001 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d576af-4334-459b-bc20-c16e6297980c None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:28.947000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-50d576af-4334-459b-bc20-c16e6297980c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:28.996916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badf1ed60a1d4b14ac3832d3a5caac88'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.009101 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badf1ed60a1d4b14ac3832d3a5caac88'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.030280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badf1ed60a1d4b14ac3832d3a5caac88'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.030552 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d576af-4334-459b-bc20-c16e6297980c None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:29.031122 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badf1ed60a1d4b14ac3832d3a5caac88'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.034829 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:29.035496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.035866 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.036138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.042738 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-a72cd526-db1e-49db-81a5-0930a26971c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badf1ed60a1d4b14ac3832d3a5caac88'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.049805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1382/2774] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:28 2022] DELETE /identity/v3/users/badf1ed60a1d4b14ac3832d3a5caac88 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:29.052702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:29.054092 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:29.054209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.054414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.054683 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.066947 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1393/2775] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:29.075187 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:29.076406 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:29.171064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1383/2776] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:29.184796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:29.187463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:29.203117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0369af-b353-434d-8a8e-1a7700fc167a service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:29.264948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:29.265593 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.265856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.266133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.276462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:29.278017 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:29.288690 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1394/2777] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:29.507946 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:29.509740 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:29.531358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba7e69-daa9-4664-ac03-ab815fb20e53 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:29.538325 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:29.539519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.539990 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.540278 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] PATH_INFO: `/v3/projects/2c589386dfe1410fad77ccc39c8de8a9` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.542283 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c589386dfe1410fad77ccc39c8de8a9)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:29.546374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:29.628927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c589386dfe1410fad77ccc39c8de8a9', 'request_id': 'req-d76eb713-87c3-4699-b55a-7916d601873e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.641214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c589386dfe1410fad77ccc39c8de8a9', 'request_id': 'req-d76eb713-87c3-4699-b55a-7916d601873e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.651241 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c589386dfe1410fad77ccc39c8de8a9', 'request_id': 'req-d76eb713-87c3-4699-b55a-7916d601873e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.668468 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] The token cache is being invalidate because project 2c589386dfe1410fad77ccc39c8de8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:29.668750 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.669374 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.671130 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1384/2778] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:29 2022] DELETE /identity/v3/projects/2c589386dfe1410fad77ccc39c8de8a9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:29.675744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:29.688893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ec961-3e30-48e7-a1ac-a03aad7bd3ac service neutron] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:29.689303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:29.691824 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:29.694200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:29.711853 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:29.781177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76eb713-87c3-4699-b55a-7916d601873e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:29.783386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:29.785626 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.786062 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.786616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] PATH_INFO: `/v3/users/b8fed5126a0b4b3bb556f2e545a32b3d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.787436 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:29.787929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fed5126a0b4b3bb556f2e545a32b3d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:29.788455 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:29.788925 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:29.789379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] PATH_INFO: `/v3/projects/26b63fd377d84e3097de168de78c3d7c` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:29.789922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:29.791086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b63fd377d84e3097de168de78c3d7c)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:29.794844 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:29.855812 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fed5126a0b4b3bb556f2e545a32b3d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.870828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fed5126a0b4b3bb556f2e545a32b3d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.871280 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b63fd377d84e3097de168de78c3d7c', 'request_id': 'req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.871843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fed5126a0b4b3bb556f2e545a32b3d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.881870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b63fd377d84e3097de168de78c3d7c', 'request_id': 'req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.887178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fed5126a0b4b3bb556f2e545a32b3d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.887798 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fed5126a0b4b3bb556f2e545a32b3d'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.893928 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b63fd377d84e3097de168de78c3d7c', 'request_id': 'req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.904704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1395/2779] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:29 2022] DELETE /identity/v3/users/b8fed5126a0b4b3bb556f2e545a32b3d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:29.908201 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] The token cache is being invalidate because project 26b63fd377d84e3097de168de78c3d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:29.908604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.909342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:29.911178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1385/2780] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:29 2022] DELETE /identity/v3/projects/26b63fd377d84e3097de168de78c3d7c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:29.915743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:29.917895 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.034110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a4f37c-7f69-4b81-a9ef-fcf4c5c7b7a9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:30.039022 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:30.039704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.039978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.040250 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] PATH_INFO: `/v3/users/755207491b7d484faa45cb90c96b35f8` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.041502 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=755207491b7d484faa45cb90c96b35f8)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:30.043437 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:30.086106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:30.119242 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755207491b7d484faa45cb90c96b35f8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.142757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755207491b7d484faa45cb90c96b35f8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.143882 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755207491b7d484faa45cb90c96b35f8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.154199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755207491b7d484faa45cb90c96b35f8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.155039 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755207491b7d484faa45cb90c96b35f8'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.172503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1396/2781] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:29 2022] DELETE /identity/v3/users/755207491b7d484faa45cb90c96b35f8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:30.323168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:30.328342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.422233 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd57b06-54b6-4ea2-a2bb-11dd71b82d8e admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:30.488148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:30.508897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:30.509839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.510330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.510818 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] PATH_INFO: `/v3/projects/02d95ae65c2045078a2d59a77a688217` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.513034 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] RBAC: Authorizing `identity:delete_project(project_id=02d95ae65c2045078a2d59a77a688217)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:30.516935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:30.581414 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02d95ae65c2045078a2d59a77a688217', 'request_id': 'req-fdaf2b74-40c6-4b6b-8676-7338a78e444d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.592625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02d95ae65c2045078a2d59a77a688217', 'request_id': 'req-fdaf2b74-40c6-4b6b-8676-7338a78e444d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.599209 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:30.602345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.603894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02d95ae65c2045078a2d59a77a688217', 'request_id': 'req-fdaf2b74-40c6-4b6b-8676-7338a78e444d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.625142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] The token cache is being invalidate because project 02d95ae65c2045078a2d59a77a688217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:30.625805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.626882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fdaf2b74-40c6-4b6b-8676-7338a78e444d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.629303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1386/2782] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:30 2022] DELETE /identity/v3/projects/02d95ae65c2045078a2d59a77a688217 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:30.635885 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4a11-22d1-4844-a2a3-88c23f8ae6bf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.636164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4a11-22d1-4844-a2a3-88c23f8ae6bf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.636450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e4a11-22d1-4844-a2a3-88c23f8ae6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.657241 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdd33f-c6e0-498b-bc84-c5555af1d0f9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:30.668421 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-d98e4a11-22d1-4844-a2a3-88c23f8ae6bf None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:30.670380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d98e4a11-22d1-4844-a2a3-88c23f8ae6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.757930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1387/2783] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:30.762320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:30.763114 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.763768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.764333 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] PATH_INFO: `/v3/projects/ef1b960ca17c4f5eb59964146a230c79` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.766214 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1b960ca17c4f5eb59964146a230c79)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:30.767228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.767643 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.768081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.769803 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:30.793548 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:30.794935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.803435 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1388/2784] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:30.807828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:30.817499 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b6f76-34e9-4ee6-bdbf-7e529d31edee None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:30.829844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1b960ca17c4f5eb59964146a230c79', 'request_id': 'req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.835838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1b960ca17c4f5eb59964146a230c79', 'request_id': 'req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.842494 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1b960ca17c4f5eb59964146a230c79', 'request_id': 'req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.870966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] The token cache is being invalidate because project ef1b960ca17c4f5eb59964146a230c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:30.871694 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.872171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-09181f6c-dffa-41a4-9d9d-db9c4f931cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:30.874027 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1397/2785] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:30 2022] DELETE /identity/v3/projects/ef1b960ca17c4f5eb59964146a230c79 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:30.881019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0215ca-a70b-4eda-9369-161731f86b80 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.881519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0215ca-a70b-4eda-9369-161731f86b80 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.882843 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0215ca-a70b-4eda-9369-161731f86b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.894404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:30.895049 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.895326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.895600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.896333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:30.896936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:30.899971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:30.908712 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-8a0215ca-a70b-4eda-9369-161731f86b80 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:30.910265 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-8a0215ca-a70b-4eda-9369-161731f86b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.919454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1389/2786] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:28:30.921658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1398/2787] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:30.927756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:30.930286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.933430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.933891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.934167 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.948175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c65e4a-db6c-4492-8ef4-e57e689d6b25 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:30.954424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:30.955111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:30.955396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:30.955739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:30.956465 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:30.958812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:30.965927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:30.975256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:30.976477 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:30.986791 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1399/2788] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:30.996495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.009334 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1390/2789] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:30 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:31.009551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a2a8d-989b-4116-b6b9-6514f28dd95a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.011082 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.033342 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:31.076473 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.077086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.077357 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.077655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.078320 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:31.078796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.080788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.084659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f2b26-d149-4253-b318-04dc9441fc79 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.090756 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.091503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.091810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.092177 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.092911 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.093689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1400/2790] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 27 02:28:31.095260 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.098442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.110470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48def58c-996c-4e71-ad35-040730d911fa admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.116820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.117649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.117908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.118281 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.119000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.121384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1391/2791] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:31.121643 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.125720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.137256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9678b40-3663-405a-a484-d77bba4ddb87 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.143524 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.144356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.144812 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.145485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.146705 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.149236 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.157411 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1401/2792] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:31.162463 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.163512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1392/2793] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:31.168016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.178564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfc2c43-6e76-493b-8e2a-1497957c4778 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.261848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf7a51-a7b3-48d8-9475-d1cb669ca0a0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.267309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.267923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.268196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.268537 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.268763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.269117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.269383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.269687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.270242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.270604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.271343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.272199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.285323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1393/2794] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:31.290489 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.301507 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1402/2795] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:31.313858 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.314039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32eb47-aaa6-462b-9f5c-04908a3dde32 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.317843 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.318065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd72e-4ff5-4a2c-b353-726795b05252 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.318176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.318176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.318176 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] PATH_INFO: `/v3/projects/c39593b3283141478f0a752173e1a59d/users/f869f75ec0df42e18408edd8a0365148/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.321030 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.323133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.323133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.323133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.323133 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.325053 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.337433 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1403/2796] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:31.340454 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39593b3283141478f0a752173e1a59d, user_id=f869f75ec0df42e18408edd8a0365148, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.340901 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.343552 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f384534a-6ffb-490b-90c2-ee9b69710e54 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.363980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8ce0e-4291-4002-a842-859d711bfa06 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.369574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1394/2797] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:31 2022] PUT /identity/v3/projects/c39593b3283141478f0a752173e1a59d/users/f869f75ec0df42e18408edd8a0365148/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:31.381328 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.381654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.381910 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.413208 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] MFA Rules not processed for user `f869f75ec0df42e18408edd8a0365148`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:31.414592 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:31.442344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.443055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.443464 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.443826 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.444592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.446957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.459783 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1404/2798] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:31.460169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:31.464254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.475424 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d40df-f795-4e5d-a20b-54493e9fe8f0 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.481117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.481839 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.482096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.482378 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] PATH_INFO: `/v3/projects/1cbd1d2d1593434582bc39828ce2c640/users/6be9fed42ade4acea7a17a00ff4cadb1/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.486000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:31.501561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbd1d2d1593434582bc39828ce2c640, user_id=6be9fed42ade4acea7a17a00ff4cadb1, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.504326 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65032d-66f7-45f6-b620-b1ecb270bee1 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.519637 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1395/2799] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:31.521619 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1405/2800] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:31 2022] PUT /identity/v3/projects/1cbd1d2d1593434582bc39828ce2c640/users/6be9fed42ade4acea7a17a00ff4cadb1/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:31.528932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.535696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.536073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.536415 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.543085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b8073-9ba1-4a36-ac34-37db456d4fc6 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.576968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] MFA Rules not processed for user `6be9fed42ade4acea7a17a00ff4cadb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:31.578664 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:31.629706 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.630698 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.631067 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.631486 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.632371 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.635669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.676534 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1406/2801] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:31.676898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1396/2802] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:31.681774 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.682132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.695394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db942b1d-d5d2-432c-9ba0-92bd0aec9635 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.766789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.767445 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.767720 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.768081 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.768929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.771775 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.775401 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17779ced-70fb-4cf5-b1e9-70404f8d33d9 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.780504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.781182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.781798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.782111 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.782807 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.785600 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.802744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1407/2803] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:31.809018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.822899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318f02-5534-4d8b-b416-a57fabdcdb92 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.829458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1397/2804] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:31.829754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.829754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.829754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.829754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.830165 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.831922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.834606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.844586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1408/2805] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:31.849021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.860119 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15aeb3e-88ec-45a8-a415-305c04b5be57 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.905291 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:31.931107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:31.942681 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.943380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.943661 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.943939 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] PATH_INFO: `/v3/projects/875c7c682f9e466ab833d9284e12eb85/users/4c3fe244c9b8414e9bf2a71b22a2361f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.947081 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f69f6-1044-4c5a-8c3c-6fe84849eee5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:31.953710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:31.954370 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:31.954728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:31.955004 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:31.955681 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.957866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.963442 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875c7c682f9e466ab833d9284e12eb85, user_id=4c3fe244c9b8414e9bf2a71b22a2361f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:31.966301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:31.983978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1398/2806] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:31 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:31.984444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1409/2807] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:31 2022] PUT /identity/v3/projects/875c7c682f9e466ab833d9284e12eb85/users/4c3fe244c9b8414e9bf2a71b22a2361f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:31.988164 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.990654 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:31.999391 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dce9e-b642-4a19-9dbb-322c9a427ba0 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.077795 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115271-a0a7-4dd2-84fb-3765fe66b821 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.083847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.084496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.084773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.085042 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.085769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.088819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.100075 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1410/2808] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:32.104917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.118746 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd3f88-8db3-4eca-86b9-3f0e89329d78 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.124146 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.125095 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.125536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.125816 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] PATH_INFO: `/v3/projects/875c7c682f9e466ab833d9284e12eb85/users/4c3fe244c9b8414e9bf2a71b22a2361f/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.127983 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875c7c682f9e466ab833d9284e12eb85, user_id=4c3fe244c9b8414e9bf2a71b22a2361f, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.130780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9ae09-3132-4b65-b056-ffdcce660d33 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.143313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1411/2809] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:32 2022] PUT /identity/v3/projects/875c7c682f9e466ab833d9284e12eb85/users/4c3fe244c9b8414e9bf2a71b22a2361f/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:32.155151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.155460 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.155710 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.185855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] MFA Rules not processed for user `4c3fe244c9b8414e9bf2a71b22a2361f`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:32.187134 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:32.206246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.207055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.207345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.207620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.208314 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.210027 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.221349 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1399/2810] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:32.226073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.236143 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f2824-a67a-49b4-ba88-265dc8c84c49 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.267268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1412/2811] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:32.279434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.280844 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:32.297231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.297981 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.298326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.298659 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.299373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.300984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.317166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1400/2812] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:32.322028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.332916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a3c1b-6e62-4d10-8cf2-91412a084b84 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.335354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:32.338351 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.339035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.339322 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.339597 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] PATH_INFO: `/v3/projects/51f9955ca0e94921a42d775f798269ad/users/9be2b9857981480cb1dc63410e63aff4/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.346629 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829de9c1-bc9e-494b-9d3f-c89812fd0eee None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.350490 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.351106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.351382 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.351647 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.356678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f9955ca0e94921a42d775f798269ad, user_id=9be2b9857981480cb1dc63410e63aff4, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.359359 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e6d94-0d50-4fa2-80a1-b2cfffc2dc44 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.361978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.363412 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.373847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1413/2813] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:32.484943 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1401/2814] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:32 2022] PUT /identity/v3/projects/51f9955ca0e94921a42d775f798269ad/users/9be2b9857981480cb1dc63410e63aff4/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:32.498016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.499759 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:32.502333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.502782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.503211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.513309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585a05-9699-4582-b928-81f84d6d6cfa service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.545188 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] MFA Rules not processed for user `9be2b9857981480cb1dc63410e63aff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:32.546751 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:32.574866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:32.581308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.582206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.582610 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.582880 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.647755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1402/2815] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:32.652728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.669807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.671304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.683019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1414/2816] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:32.742517 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf70a0-1160-4fe4-a94f-a980e906fb6e None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.748473 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.749189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.749810 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.750242 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.751095 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.753897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.802833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1403/2817] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:32.807861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.820351 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b56eff-9cd9-45bc-ada9-fa02ea468f49 service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.897875 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.898527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.898744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.899016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.899732 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.901827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.927977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1415/2818] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:32 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:32.932588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.944357 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd382e-835c-41ee-8d43-945251281178 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.950324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.951055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.951418 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.951776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:32.952476 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:32.954450 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:32.965982 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1404/2819] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 27 02:28:32.970465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:32.982929 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63b5111-b44c-43af-a1af-c802515abf0b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:32.988802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:32.989601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:32.989887 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:32.990157 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] PATH_INFO: `/v3/projects/3324e282219f4d409df9d3464d92fedc/users/3be6d4efda7f4ba288ce560f95d66780/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:33.021171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3324e282219f4d409df9d3464d92fedc, user_id=3be6d4efda7f4ba288ce560f95d66780, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:33.025645 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:33.054059 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1416/2820] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:32 2022] PUT /identity/v3/projects/3324e282219f4d409df9d3464d92fedc/users/3be6d4efda7f4ba288ce560f95d66780/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:33.055685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:33.070998 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91227c7-0b11-47cb-bc39-6bca26d5e3c4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:33.174413 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:33.175266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:33.175695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:33.176068 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:33.176841 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:33.179211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773a48-ae3e-4ab5-b767-98820e56987f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:33.194175 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1405/2821] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:33.201190 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:33.218198 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b9e8d-f005-4fce-a3d2-c859360f3303 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:33.225371 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:33.226215 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:33.226663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:33.227135 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] PATH_INFO: `/v3/projects/3324e282219f4d409df9d3464d92fedc/users/3be6d4efda7f4ba288ce560f95d66780/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:33.230109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3324e282219f4d409df9d3464d92fedc, user_id=3be6d4efda7f4ba288ce560f95d66780, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:33.234793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:33.237656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:33.249034 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1417/2822] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:33 2022] PUT /identity/v3/projects/3324e282219f4d409df9d3464d92fedc/users/3be6d4efda7f4ba288ce560f95d66780/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:33.260627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:33.260979 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:33.261265 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:33.297509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] MFA Rules not processed for user `3be6d4efda7f4ba288ce560f95d66780`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:33.299645 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:33.339217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:33.406142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1406/2823] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:33.421284 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:33.492696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc4bb7-dfbf-44f4-8500-5af7342e1ab8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:33.496369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:33.496984 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:33.497257 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:33.497566 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:33.583115 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:33.584244 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:33.597640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1418/2824] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:35.216996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:35.228931 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf82a52-2ae9-49dd-994f-edc5118905c3 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:35.233442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:35.234072 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:35.234356 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:35.234675 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:35.309234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:35.311531 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:35.327342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1407/2825] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:36.101317 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:36.117319 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075fb26-8b67-4ce7-b472-f82dc0ff43ac service cinder] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:36.121514 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:36.122367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:36.122827 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:36.123334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:36.134838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:36.136571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ecd36-6bf3-4c31-8006-42f5dd7f6800 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:36.148130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1419/2826] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:36.469941 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:36.556031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cef45-476d-45cc-b94d-9820eafbe889 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:36.561542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:36.562343 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:36.562772 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:36.563116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] PATH_INFO: `/v3/users/f869f75ec0df42e18408edd8a0365148` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:36.564607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f869f75ec0df42e18408edd8a0365148)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:36.566628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:36.625889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f869f75ec0df42e18408edd8a0365148'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:36.639002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f869f75ec0df42e18408edd8a0365148'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:36.648270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:36.662336 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f869f75ec0df42e18408edd8a0365148'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:36.663189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f869f75ec0df42e18408edd8a0365148'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:36.672350 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f869f75ec0df42e18408edd8a0365148'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:36.680028 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1408/2827] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:36 2022] DELETE /identity/v3/users/f869f75ec0df42e18408edd8a0365148 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:36.685071 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:36.685454 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:36.685708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:36.709063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:36.709063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:36.776966 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1420/2828] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:36.790953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:36.793168 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:36.874570 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48758d-01d3-4fd9-b4dd-6c75a8954676 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:36.881086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:36.881801 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:36.882131 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:36.882433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:36.895196 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:36.897035 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:36.910186 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1409/2829] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:37.220430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:37.222457 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:37.241210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af9524-1788-4328-8851-4d990f92f9ba None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:37.247282 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:37.248861 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:37.249684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:37.249999 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] PATH_INFO: `/v3/projects/c39593b3283141478f0a752173e1a59d` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:37.251476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39593b3283141478f0a752173e1a59d)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:37.253475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:37.302309 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:37.328051 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39593b3283141478f0a752173e1a59d', 'request_id': 'req-26886d66-b46a-4383-ba84-48614f0c3ace'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.334655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39593b3283141478f0a752173e1a59d', 'request_id': 'req-26886d66-b46a-4383-ba84-48614f0c3ace'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.341942 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39593b3283141478f0a752173e1a59d', 'request_id': 'req-26886d66-b46a-4383-ba84-48614f0c3ace'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.359678 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] The token cache is being invalidate because project c39593b3283141478f0a752173e1a59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:37.360024 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.360799 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.362832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1421/2830] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:37 2022] DELETE /identity/v3/projects/c39593b3283141478f0a752173e1a59d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:37.367519 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:37.380162 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e703f-ffa8-49d7-8fb0-ecc27349bedc service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:37.463601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:37.464342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:37.464654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:37.464934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] PATH_INFO: `/v3/users/4c3fe244c9b8414e9bf2a71b22a2361f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:37.466873 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c3fe244c9b8414e9bf2a71b22a2361f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:37.469711 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:37.531977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c3fe244c9b8414e9bf2a71b22a2361f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.542301 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c3fe244c9b8414e9bf2a71b22a2361f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.558469 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c3fe244c9b8414e9bf2a71b22a2361f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.559287 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c3fe244c9b8414e9bf2a71b22a2361f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.567245 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-aebbc91f-42a4-4a7f-9851-eb53b05a4a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c3fe244c9b8414e9bf2a71b22a2361f'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:37.569319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:37.575952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1410/2831] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:37 2022] DELETE /identity/v3/users/4c3fe244c9b8414e9bf2a71b22a2361f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:37.967187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:37.968698 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:37.988595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26886d66-b46a-4383-ba84-48614f0c3ace admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.068554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.069226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.069531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.069833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] PATH_INFO: `/v3/projects/875c7c682f9e466ab833d9284e12eb85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.070977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875c7c682f9e466ab833d9284e12eb85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.073381 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.127782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875c7c682f9e466ab833d9284e12eb85', 'request_id': 'req-7c8b60bc-2855-4228-8506-e783d00afcf2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:38.135129 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875c7c682f9e466ab833d9284e12eb85', 'request_id': 'req-7c8b60bc-2855-4228-8506-e783d00afcf2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:38.142813 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875c7c682f9e466ab833d9284e12eb85', 'request_id': 'req-7c8b60bc-2855-4228-8506-e783d00afcf2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:38.160673 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] The token cache is being invalidate because project 875c7c682f9e466ab833d9284e12eb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:38.161012 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:38.161910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-7c8b60bc-2855-4228-8506-e783d00afcf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:38.164093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1422/2832] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:37 2022] DELETE /identity/v3/projects/875c7c682f9e466ab833d9284e12eb85 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:38.170006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.170333 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.170644 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.192502 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:38.193735 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:38.260993 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1411/2833] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:38.269716 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.270549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.270549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.292106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:38.293435 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:38.302750 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1423/2834] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:38.307917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.319329 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02a96b-6346-4af7-9016-41685d075a23 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.325138 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.325937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.326234 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.326504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.327569 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:38.327939 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.329813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.344146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1412/2835] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:38.349207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.359640 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33122aa-3b96-4edd-b228-b10207792c41 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.365531 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.366588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.367046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.367503 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.368334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.370380 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.402876 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1424/2836] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:38.408180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.420937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893a01f-e03a-4853-b287-8e83dcd0c47a admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.492605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.493254 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.493576 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.493855 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.494561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.496639 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.521745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1413/2837] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:38.526670 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.538584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a46-ee72-4cbe-a016-3453aec2b5f9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.543687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.544323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.544601 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.544898 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.545625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.547394 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.559253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1425/2838] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:38.564695 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.577656 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c51e4-c08c-4d8b-b3e1-3f1b4ef58775 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.585235 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.586141 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.586423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.586897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.587838 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.590217 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a82d96-bccc-4849-8dd7-8bc05904e091 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.605685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1414/2839] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:38.611736 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.627636 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3f64b-f193-4a70-bf95-0d8ac0a94d11 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.635018 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.635713 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.635987 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.636253 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] PATH_INFO: `/v3/projects/7482a7d8413542728d5ac163bf977d85/users/e83a9a490488447aa0e5e6a997b105df/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.640696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:38.657117 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7482a7d8413542728d5ac163bf977d85, user_id=e83a9a490488447aa0e5e6a997b105df, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.660015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.678073 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1426/2840] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:38 2022] PUT /identity/v3/projects/7482a7d8413542728d5ac163bf977d85/users/e83a9a490488447aa0e5e6a997b105df/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:38.690769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.691103 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.691603 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.726984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] MFA Rules not processed for user `e83a9a490488447aa0e5e6a997b105df`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:38.728308 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:38.808678 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:38.822574 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1415/2841] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:38.827019 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.919771 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dfb51-11e4-4d78-ae27-679483b07e7d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:38.925387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:38.926161 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:38.926511 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:38.927428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:38.927555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:38.929868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:38.966933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1427/2842] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:38.968045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:38.981900 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbb28-a4cc-4e6c-91e0-5c46ae47c720 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.055485 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.056181 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.056442 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.056726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.057380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.059901 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.087542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1416/2843] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:38 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:39.093691 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.111395 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27573e1-b0ab-4a50-86bf-1e3a6b801b9c admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.116376 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.117110 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.117486 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.117860 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.118584 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.120491 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.132212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1428/2844] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:39.136511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.148466 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835f178-8d33-453d-94e9-6ca00a82dd54 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.154046 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.154728 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.155038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.155326 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.156039 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.157774 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addae53c-ccd7-459c-913d-d974924c2d73 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.168604 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1417/2845] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:39.173217 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.183617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32122228-731c-4c76-8935-4826246b2a23 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.191107 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.191769 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.192080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.192346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] PATH_INFO: `/v3/projects/16f7f12ec8434f78b6cb93c115ea0152/users/0cb981662b6f4c87b0466181deab5b4a/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.208418 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f7f12ec8434f78b6cb93c115ea0152, user_id=0cb981662b6f4c87b0466181deab5b4a, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.211124 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.225120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1429/2846] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:39 2022] PUT /identity/v3/projects/16f7f12ec8434f78b6cb93c115ea0152/users/0cb981662b6f4c87b0466181deab5b4a/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:39.236452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.236737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.237006 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.270598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] MFA Rules not processed for user `0cb981662b6f4c87b0466181deab5b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:39.271850 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:39.340135 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1418/2847] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:39.345223 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.411754 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8c599-4471-4963-a2c2-16c13b83be79 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.417630 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.418322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.418726 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.419093 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.419773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.422000 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.451850 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1430/2848] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:39 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:39.456286 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.468229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b360e-c113-4f78-80e3-0c5f377e5ec4 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.527782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.528405 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.528672 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.528953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.529614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.531646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.540631 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:39.552866 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1419/2849] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:39 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:39.557138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.571481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fccfa-d4f3-4f2f-9b16-7fc3a35bd648 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.580768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.581550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.581819 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.582196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.582957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.584768 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.597949 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1431/2850] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:39.602564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.615533 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca05bd-8f00-4c0d-a7ec-fdf4df360343 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.620796 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.621613 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.621924 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.622199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] PATH_INFO: `/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7/users/b4e0de69a9cd4ad783092baba237d5e9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.640830 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84586cc13ab346cea8d7e6d0dd5ae5f7, user_id=b4e0de69a9cd4ad783092baba237d5e9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.643732 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.660211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1420/2851] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:39 2022] PUT /identity/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7/users/b4e0de69a9cd4ad783092baba237d5e9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:39.664285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.674484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7028ad5a-1cd4-4b39-9213-0cd918aac644 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.679790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:39.733818 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.734451 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.734954 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.735226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.735864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.737496 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6da3dd-c320-4d7a-bb52-a93372e48816 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.748366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1432/2852] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:39.753249 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.766173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7955-86fb-45d2-8766-44bd6afc7418 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.774012 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.774669 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.774947 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.775273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] PATH_INFO: `/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7/users/b4e0de69a9cd4ad783092baba237d5e9/roles/5e401bf60fb64af593e7f8832f68ae16` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.777564 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84586cc13ab346cea8d7e6d0dd5ae5f7, user_id=b4e0de69a9cd4ad783092baba237d5e9, role_id=5e401bf60fb64af593e7f8832f68ae16)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:39.782194 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:39.795912 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1421/2853] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:39 2022] PUT /identity/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7/users/b4e0de69a9cd4ad783092baba237d5e9/roles/5e401bf60fb64af593e7f8832f68ae16 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:39.812366 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.812896 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.813321 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:39.843440 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] MFA Rules not processed for user `b4e0de69a9cd4ad783092baba237d5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:39.844573 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:39.915285 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1433/2854] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:39 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:39.927541 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:39.929438 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:39.988944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68613db-665a-4188-a2be-9890ef98a3b5 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:39.992995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:39.993629 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:39.993908 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:39.994178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:40.003521 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:40.004944 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:40.014839 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1422/2855] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:39 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:40.060067 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:40.061476 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:40.073963 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82399d-f8f1-4809-bcdb-8a700eadaeeb None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:40.077702 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:40.078413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:40.078687 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:40.078953 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:40.138096 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:40.140541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6f316-4017-4ab6-8812-3b6975b49ab4 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:40.150074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1434/2856] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:40.227800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:40.229437 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:40.298835 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddfcb7-851c-4be3-bfee-60b002af2434 service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:40.303769 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:40.304467 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:40.304763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:40.305231 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] PATH_INFO: `/v3/users/6be9fed42ade4acea7a17a00ff4cadb1` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:40.306882 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be9fed42ade4acea7a17a00ff4cadb1)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:40.309116 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:40.361142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be9fed42ade4acea7a17a00ff4cadb1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:40.370899 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be9fed42ade4acea7a17a00ff4cadb1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:40.376324 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:40.385932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be9fed42ade4acea7a17a00ff4cadb1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:40.387153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be9fed42ade4acea7a17a00ff4cadb1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:40.395074 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be9fed42ade4acea7a17a00ff4cadb1'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:40.402016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1423/2857] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:40 2022] DELETE /identity/v3/users/6be9fed42ade4acea7a17a00ff4cadb1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:40.407047 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025366-7414-4325-a243-847b1322fd32 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:40.407544 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025366-7414-4325-a243-847b1322fd32 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:40.407644 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28025366-7414-4325-a243-847b1322fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:40.452194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=100 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:40.468821 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-28025366-7414-4325-a243-847b1322fd32 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:40.470322 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28025366-7414-4325-a243-847b1322fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:40.614998 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1435/2858] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:40.627433 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:40.629420 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:40.696404 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd14777-1364-4d04-bfe5-dedd4d7882ae admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:40.700319 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:40.700929 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:40.701214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:40.701494 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:40.711444 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:40.712976 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:40.722859 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1424/2859] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:41.026635 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025366-7414-4325-a243-847b1322fd32 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:41.028147 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-28025366-7414-4325-a243-847b1322fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:41.040517 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28025366-7414-4325-a243-847b1322fd32 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:41.046200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:41.046868 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:41.047273 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:41.047638 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] PATH_INFO: `/v3/projects/1cbd1d2d1593434582bc39828ce2c640` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:41.049048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbd1d2d1593434582bc39828ce2c640)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:41.051137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:41.100796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbd1d2d1593434582bc39828ce2c640', 'request_id': 'req-c2c6256a-e82d-4d99-9609-d8e6a89321ab'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.106519 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbd1d2d1593434582bc39828ce2c640', 'request_id': 'req-c2c6256a-e82d-4d99-9609-d8e6a89321ab'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.113961 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbd1d2d1593434582bc39828ce2c640', 'request_id': 'req-c2c6256a-e82d-4d99-9609-d8e6a89321ab'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.129729 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] The token cache is being invalidate because project 1cbd1d2d1593434582bc39828ce2c640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:41.130016 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.130652 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.132140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1436/2860] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:41 2022] DELETE /identity/v3/projects/1cbd1d2d1593434582bc39828ce2c640 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:41.136266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:41.146739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663222a-4a7c-42f4-b243-249422eb3640 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:41.206244 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:41.206871 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:41.207148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:41.207423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] PATH_INFO: `/v3/users/9be2b9857981480cb1dc63410e63aff4` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:41.208565 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be2b9857981480cb1dc63410e63aff4)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:41.210555 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:41.257986 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be2b9857981480cb1dc63410e63aff4'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.266158 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be2b9857981480cb1dc63410e63aff4'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.278045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be2b9857981480cb1dc63410e63aff4'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.278703 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be2b9857981480cb1dc63410e63aff4'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.283214 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:41.286237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be2b9857981480cb1dc63410e63aff4'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.293484 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1425/2861] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:41 2022] DELETE /identity/v3/users/9be2b9857981480cb1dc63410e63aff4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:41.600268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:41.604210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:41.636800 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6256a-e82d-4d99-9609-d8e6a89321ab admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:41.689228 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:41.709776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:41.710563 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:41.710757 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:41.710997 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] PATH_INFO: `/v3/projects/51f9955ca0e94921a42d775f798269ad` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:41.715837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f9955ca0e94921a42d775f798269ad)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:41.715837 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:41.772254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f9955ca0e94921a42d775f798269ad', 'request_id': 'req-75718ebb-3dc7-4c51-945b-e215bbab6870'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.778393 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f9955ca0e94921a42d775f798269ad', 'request_id': 'req-75718ebb-3dc7-4c51-945b-e215bbab6870'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.784838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f9955ca0e94921a42d775f798269ad', 'request_id': 'req-75718ebb-3dc7-4c51-945b-e215bbab6870'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.797788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] The token cache is being invalidate because project 51f9955ca0e94921a42d775f798269ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:41.798074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.798761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.800434 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1437/2862] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:41 2022] DELETE /identity/v3/projects/51f9955ca0e94921a42d775f798269ad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:41.804960 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:41.806542 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:41.820685 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbadd967-15cc-44ff-af75-cff3c031db45 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:41.899690 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:41.900384 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:41.900823 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:41.901132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] PATH_INFO: `/v3/users/3be6d4efda7f4ba288ce560f95d66780` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:41.902453 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3be6d4efda7f4ba288ce560f95d66780)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:41.904385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:41.959379 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3be6d4efda7f4ba288ce560f95d66780'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.967230 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3be6d4efda7f4ba288ce560f95d66780'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.980737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3be6d4efda7f4ba288ce560f95d66780'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.981475 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3be6d4efda7f4ba288ce560f95d66780'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.988897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-756d30b3-7806-4daf-bdc6-f946d62ece29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3be6d4efda7f4ba288ce560f95d66780'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:41.995192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1426/2863] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:41 2022] DELETE /identity/v3/users/3be6d4efda7f4ba288ce560f95d66780 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:42.284777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.286258 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:42.300646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718ebb-3dc7-4c51-945b-e215bbab6870 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.366413 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.366970 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.367243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.367525 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] PATH_INFO: `/v3/projects/3324e282219f4d409df9d3464d92fedc` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.368936 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3324e282219f4d409df9d3464d92fedc)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.370933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.423624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3324e282219f4d409df9d3464d92fedc', 'request_id': 'req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:42.429550 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3324e282219f4d409df9d3464d92fedc', 'request_id': 'req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:42.437137 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3324e282219f4d409df9d3464d92fedc', 'request_id': 'req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:42.452289 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] The token cache is being invalidate because project 3324e282219f4d409df9d3464d92fedc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:42.452576 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:42.453305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-d929c78c-b3dd-4c59-b9a2-34e8ac7c3768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:42.454907 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1438/2864] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:42 2022] DELETE /identity/v3/projects/3324e282219f4d409df9d3464d92fedc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:42.460043 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.460331 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.460696 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.515296 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:42.516583 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:42.565224 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:42.586828 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1427/2865] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:42.660851 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.661458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.661458 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.670235 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:42.683600 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:42.685158 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:42.694789 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1439/2866] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:42.699627 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.710126 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9450e2b-21c8-4883-b77a-8b915ae97919 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.715923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.716646 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.716832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.717096 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.717790 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:42.718090 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.719755 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.732151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1428/2867] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:42.737254 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.747462 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f3cb6-85c7-48df-bcff-fd989c0cf2ff None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.753561 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.754172 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.754444 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.754711 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.755348 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.757270 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.787792 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1440/2868] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:42 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:28:42.792209 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.802953 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956f764-016c-429f-b995-1c98c24e8806 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.865478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.866197 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.866383 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.866661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.867309 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.869274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.896833 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1429/2869] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:42 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:42.901353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.912475 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be391c35-d4d2-4741-9450-fc33b04bdf0b admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.917937 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.918748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.919086 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.919365 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.920020 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.921856 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.933224 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1441/2870] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:42.937478 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.947937 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9cb16-026b-40cf-b704-f97ea95b9374 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.953523 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.954146 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.954423 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.954691 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:42.955367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:42.957002 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9525b1-07ea-4341-bddf-293a11e1dde5 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:42.968692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1430/2871] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:42.973314 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:42.984667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc87aaf-683f-4123-af23-e9bb0384bb89 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:42.990428 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:42.991109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:42.991373 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:42.991639 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] PATH_INFO: `/v3/projects/48950f3d194a467e81bc74adfca6d94f/users/6fab0689ace84088890202583f75dc3e/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.008930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48950f3d194a467e81bc74adfca6d94f, user_id=6fab0689ace84088890202583f75dc3e, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.011824 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:43.027200 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1442/2872] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:42 2022] PUT /identity/v3/projects/48950f3d194a467e81bc74adfca6d94f/users/6fab0689ace84088890202583f75dc3e/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:43.032916 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.033509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.033978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.057258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:43.057258 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.130344 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1431/2873] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:43.138823 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:43.141323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.142065 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:43.143595 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.155021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe26231-bffc-44eb-bfd6-04ce8f3e1dc6 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:43.160426 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:43.161074 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.161346 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.161650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] PATH_INFO: `/v3/users/e83a9a490488447aa0e5e6a997b105df` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.162884 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83a9a490488447aa0e5e6a997b105df)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.164776 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:43.211702 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:43.218667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83a9a490488447aa0e5e6a997b105df'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.229852 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae859a6-974e-4244-9ab6-5e0cd6af36cd None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:43.232401 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83a9a490488447aa0e5e6a997b105df'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.233094 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83a9a490488447aa0e5e6a997b105df'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.233616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:43.234284 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.234567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.234966 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.237216 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.242054 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83a9a490488447aa0e5e6a997b105df'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.242704 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-aca9c21f-4e32-4b45-89c6-e6dcdf7565c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83a9a490488447aa0e5e6a997b105df'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.251132 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.252663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:43.257100 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1443/2874] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:43 2022] DELETE /identity/v3/users/e83a9a490488447aa0e5e6a997b105df => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:43.261646 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.261930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.262203 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.264650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1432/2875] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:43.282375 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:43.283625 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.353416 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1444/2876] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:43.363722 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:43.365323 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.377715 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f783-98bf-45ed-9bc9-f7b0afca01fc service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:43.436782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:43.437514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.437794 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.438057 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.449625 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.451259 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:43.463967 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1433/2877] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:43.804361 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:43.805900 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:43.818662 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31b521-747b-46ae-9ebf-515a9874ddc5 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:43.823828 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:43.824465 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.824740 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.825006 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] PATH_INFO: `/v3/projects/7482a7d8413542728d5ac163bf977d85` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.826492 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7482a7d8413542728d5ac163bf977d85)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.828867 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:43.838847 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:43.881334 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7482a7d8413542728d5ac163bf977d85', 'request_id': 'req-c237b4d0-1699-4b38-9dac-f5554cfd2064'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.887536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7482a7d8413542728d5ac163bf977d85', 'request_id': 'req-c237b4d0-1699-4b38-9dac-f5554cfd2064'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.894790 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7482a7d8413542728d5ac163bf977d85', 'request_id': 'req-c237b4d0-1699-4b38-9dac-f5554cfd2064'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.908246 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] The token cache is being invalidate because project 7482a7d8413542728d5ac163bf977d85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:43.908536 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.909179 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-c237b4d0-1699-4b38-9dac-f5554cfd2064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:43.910975 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1445/2878] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:43 2022] DELETE /identity/v3/projects/7482a7d8413542728d5ac163bf977d85 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:43.914962 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:43.925785 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13685167-99ee-4d11-83f5-9c1d8bcb508a service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:43.988699 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:43.989355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:43.989661 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:43.989932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] PATH_INFO: `/v3/users/0cb981662b6f4c87b0466181deab5b4a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:43.991272 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb981662b6f4c87b0466181deab5b4a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:43.993458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:44.011112 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:44.011658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:44.012080 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:44.044423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] MFA Rules not processed for user `6fab0689ace84088890202583f75dc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:44.045927 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:44.061688 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb981662b6f4c87b0466181deab5b4a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.070996 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb981662b6f4c87b0466181deab5b4a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.084874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb981662b6f4c87b0466181deab5b4a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.085630 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb981662b6f4c87b0466181deab5b4a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.093663 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb981662b6f4c87b0466181deab5b4a'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.100316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1434/2879] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:43 2022] DELETE /identity/v3/users/0cb981662b6f4c87b0466181deab5b4a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:44.139303 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1446/2880] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:44.150566 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:44.152106 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:44.159562 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:44.227310 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fe4495-bf66-4bf3-9cd6-ab58669ad66f admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:44.231424 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:44.232115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:44.232460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:44.232798 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:44.298532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:44.300045 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:44.309917 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1435/2881] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:44.408658 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:44.410814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:44.427427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5e47c-9bb3-4b37-91cd-ffd34edcc576 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:44.496291 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:44.497009 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:44.497347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:44.497708 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] PATH_INFO: `/v3/projects/16f7f12ec8434f78b6cb93c115ea0152` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:44.499106 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f7f12ec8434f78b6cb93c115ea0152)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:44.501077 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:44.536655 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:44.556834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f7f12ec8434f78b6cb93c115ea0152', 'request_id': 'req-614b7c17-b364-49d8-b46b-37f84dbd49a5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.565007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f7f12ec8434f78b6cb93c115ea0152', 'request_id': 'req-614b7c17-b364-49d8-b46b-37f84dbd49a5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.588793 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f7f12ec8434f78b6cb93c115ea0152', 'request_id': 'req-614b7c17-b364-49d8-b46b-37f84dbd49a5'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.610028 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] The token cache is being invalidate because project 16f7f12ec8434f78b6cb93c115ea0152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:44.610452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.611324 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.613187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1447/2882] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:44 2022] DELETE /identity/v3/projects/16f7f12ec8434f78b6cb93c115ea0152 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:44.617684 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:44.628894 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe363b-e59c-4c13-918f-bffeb12581df service cinder] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:44.690173 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:44.690889 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:44.691166 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:44.691417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] PATH_INFO: `/v3/users/b4e0de69a9cd4ad783092baba237d5e9` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:44.692581 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e0de69a9cd4ad783092baba237d5e9)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:44.694532 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:44.744588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e0de69a9cd4ad783092baba237d5e9'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.753091 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e0de69a9cd4ad783092baba237d5e9'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.758874 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:44.767832 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e0de69a9cd4ad783092baba237d5e9'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.768788 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e0de69a9cd4ad783092baba237d5e9'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.775710 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e0de69a9cd4ad783092baba237d5e9'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:44.781607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1436/2883] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:44 2022] DELETE /identity/v3/users/b4e0de69a9cd4ad783092baba237d5e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:45.003046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.004562 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.071225 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.072635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.072916 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b7c17-b364-49d8-b46b-37f84dbd49a5 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.127971 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.128695 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.129041 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.129315 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.131063 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.143968 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e92cb-72ed-4f8b-8545-890127bb74f0 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.149320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.150038 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.150316 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.150650 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] PATH_INFO: `/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.151736 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84586cc13ab346cea8d7e6d0dd5ae5f7)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.153848 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.191144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.192603 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5945c85-509f-4e16-9d64-d33d8f7765d1 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.201827 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84586cc13ab346cea8d7e6d0dd5ae5f7', 'request_id': 'req-1403db62-37a7-4d15-939c-45113a5c4a52'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:45.202431 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1448/2884] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:45.210816 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84586cc13ab346cea8d7e6d0dd5ae5f7', 'request_id': 'req-1403db62-37a7-4d15-939c-45113a5c4a52'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:45.218169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84586cc13ab346cea8d7e6d0dd5ae5f7', 'request_id': 'req-1403db62-37a7-4d15-939c-45113a5c4a52'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:45.231017 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] The token cache is being invalidate because project 84586cc13ab346cea8d7e6d0dd5ae5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:45.231402 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:45.232121 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-1403db62-37a7-4d15-939c-45113a5c4a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:45.233920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1437/2885] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:45 2022] DELETE /identity/v3/projects/84586cc13ab346cea8d7e6d0dd5ae5f7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:45.239957 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.240438 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.240814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.261605 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:45.262748 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.287153 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:45.337136 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1449/2886] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:45.347514 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.347836 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.348153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.370099 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:45.371363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.380263 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1438/2887] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:45.384848 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.395834 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7bc7-09c1-467e-8504-c71976d35a5b None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.401078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.401902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.402354 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.402782 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.403649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:45.404170 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.406308 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.419682 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1450/2888] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:45.425971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.436145 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130c867-0564-448f-bf9b-ae848a2ee10b None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.441298 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.442050 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.442330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.442614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.443256 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.445189 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.474895 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1439/2889] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:45.479299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.490164 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc8628-8130-4dda-a36f-51a8671e516d admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.556138 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.556666 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.556952 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.557221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.557897 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.559838 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.586721 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1451/2890] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/users => generated 281 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:45.591800 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.608789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e2794-e9be-4af7-bad4-d8efcf7cd593 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.615955 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.616971 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.617306 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.617930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.618862 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.621692 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.634594 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1440/2891] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:45.639933 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.654386 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8232a-2a8d-4962-894f-2ef93da92f10 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.662730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.663764 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.664239 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.664714 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.665891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.668951 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d0e8f-04ae-48c6-9697-819a77a9ae57 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.692423 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1452/2892] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:45.693936 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.704745 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6209b-76c1-41e2-b044-7ed812008185 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:45.709739 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:45.710407 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.710689 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.710964 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] PATH_INFO: `/v3/projects/d79051f9bfef4653954f41c397851ca2/users/6ef47700a9ec4a9a8e52c3c68693f000/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.733923 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79051f9bfef4653954f41c397851ca2, user_id=6ef47700a9ec4a9a8e52c3c68693f000, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:45.736922 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813a0b-a762-4449-8c67-99f6b8a94016 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:45.748353 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.748700 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.749261 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.754380 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1441/2893] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:45 2022] PUT /identity/v3/projects/d79051f9bfef4653954f41c397851ca2/users/6ef47700a9ec4a9a8e52c3c68693f000/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:45.766192 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:45.766511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:45.766782 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:45.771256 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] MFA Rules not processed for user `6fab0689ace84088890202583f75dc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:45.772482 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.775110 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:45.801815 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] MFA Rules not processed for user `6ef47700a9ec4a9a8e52c3c68693f000`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:45.803607 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.836142 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1453/2894] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:45.885238 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1442/2895] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:45.925175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:45.930305 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:45.982864 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:46.009301 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52bad-3c93-4f6e-966d-e3124774e9b4 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:46.014414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:46.014414 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:46.014669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:46.014906 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:46.024960 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:46.026331 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b624f35-3a26-4cd0-bbcf-257aab830a28 service cinder] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:46.038046 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1454/2896] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:46.057274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:46.138797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f5b1-d226-4bc8-a90c-8911696ea9c6 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:46.145069 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:46.146133 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:46.146511 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:46.146887 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] PATH_INFO: `/v3/users/6ef47700a9ec4a9a8e52c3c68693f000` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:46.148288 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef47700a9ec4a9a8e52c3c68693f000)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:46.150396 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:46.213671 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef47700a9ec4a9a8e52c3c68693f000'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:46.227157 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef47700a9ec4a9a8e52c3c68693f000'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:46.243479 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef47700a9ec4a9a8e52c3c68693f000'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:46.244243 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef47700a9ec4a9a8e52c3c68693f000'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:46.252085 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef47700a9ec4a9a8e52c3c68693f000'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:46.258588 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1443/2897] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:46 2022] DELETE /identity/v3/users/6ef47700a9ec4a9a8e52c3c68693f000 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:46.263151 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:46.263731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:46.264015 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:46.284777 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:46.286120 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:46.393150 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1455/2898] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:28:46.433509 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:46.435347 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:46.454861 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:46.515620 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f841-31a7-4e97-837e-7dc4af4ab6ac admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:46.520520 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:46.521149 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:46.521452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:46.521726 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:46.533932 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:46.535638 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f43cfb-5138-42b4-af26-84d0c0b1883e service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:46.549312 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1444/2899] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:47.113899 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.116221 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:47.148788 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d6960-9d3d-4d02-9821-11dcff047cfe None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.155337 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.155988 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.156347 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.156617 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] PATH_INFO: `/v3/projects/d79051f9bfef4653954f41c397851ca2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.159693 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79051f9bfef4653954f41c397851ca2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.162163 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.220430 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79051f9bfef4653954f41c397851ca2', 'request_id': 'req-24663da1-da66-4611-b934-51c63f68ccda'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:47.226913 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79051f9bfef4653954f41c397851ca2', 'request_id': 'req-24663da1-da66-4611-b934-51c63f68ccda'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:47.235817 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79051f9bfef4653954f41c397851ca2', 'request_id': 'req-24663da1-da66-4611-b934-51c63f68ccda'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:47.254923 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] The token cache is being invalidate because project d79051f9bfef4653954f41c397851ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81748) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:47.255302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:47.255968 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-24663da1-da66-4611-b934-51c63f68ccda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:47.263199 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1456/2900] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:47 2022] DELETE /identity/v3/projects/d79051f9bfef4653954f41c397851ca2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:47.269534 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.270073 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.270307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.305920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:47.307609 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:47.401945 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1445/2901] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:47.409592 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.410031 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.410297 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.443669 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:47.444922 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:47.454948 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1457/2902] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:47.459412 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.471365 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cc094-8784-4601-97e5-2c6e09f422b5 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.477829 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.478897 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.479180 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.479525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] PATH_INFO: `/v3/domains` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.480215 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81747) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:28:47.480513 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.482182 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.496918 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1446/2903] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:28:47.501419 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.511268 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a427810-5e40-449c-b02f-86ccba2ac218 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.516802 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.517554 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.517765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.518033 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] PATH_INFO: `/v3/projects` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.518796 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.521173 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.557944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1458/2904] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:47.562352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.576628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaa92-9feb-4a25-b187-0da20e45e8be admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.661776 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.662363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.662791 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.663977 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] PATH_INFO: `/v3/users` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.664948 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.668246 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.695183 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1447/2905] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:28:47 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:28:47.700586 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.713738 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90eba-81ec-4109-b157-4a5bcdefb9da admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.719210 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.719855 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.720131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.720567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.721061 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.722699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.736152 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1459/2906] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:47.741178 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.757632 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13c4c3-cfb8-4f5f-bd00-fa7380c5ba08 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.764983 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.766273 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.766770 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.767261 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.768408 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.771472 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83625c0-165c-4e31-9955-6a7f1a0f33bc admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.793153 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1448/2907] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:28:47.797577 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:47.815188 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec760846-e3ff-4350-a277-f76f4d30fef2 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:47.823048 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:47.824197 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.824684 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.825184 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] PATH_INFO: `/v3/projects/ede33742f949492bbfc5a3aa3072d54a/users/725df7854daa42408c0336db06db57b6/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.852471 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede33742f949492bbfc5a3aa3072d54a, user_id=725df7854daa42408c0336db06db57b6, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:47.857908 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:47.873300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:47.880367 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1460/2908] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:28:47 2022] PUT /identity/v3/projects/ede33742f949492bbfc5a3aa3072d54a/users/725df7854daa42408c0336db06db57b6/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:47.896144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:47.896144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:47.896144 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:47.927210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] MFA Rules not processed for user `725df7854daa42408c0336db06db57b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:28:47.928687 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:47.942863 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:48.016628 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1449/2909] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:28:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:28:48.030090 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:48.032527 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:48.109481 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae80cf9-eb88-4845-9757-8270e08467f7 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:48.113560 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5b1a97a2fad45899863619a3953e0c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:48.114175 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:48.115108 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:48.115547 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:48.125944 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:48.127930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:48.140299 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1461/2910] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:50.653708 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:50.655449 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:50.726766 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dacac82-9b89-4e80-a87f-a382a4f92fdf None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:50.730805 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:50.731330 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:50.731712 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:50.736193 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:50.738713 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:50.835178 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:50.837595 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:50.895598 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:50.898228 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:50.928320 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1450/2911] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:51.044964 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb9bd-6c80-4637-b6ff-256ab4d7b0a8 service glance] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:51.050810 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ddf36f45acc45fe99073dec8c3ee497', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:51.051427 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:51.051701 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:51.051977 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:51.053727 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:51.070008 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:51.072206 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:51.087036 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1462/2912] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 27 02:28:58.680737 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:58.682353 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:58.745452 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:58.746930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:58.785229 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8844de-7dcf-4fc0-99fb-50158dffbd50 service nova] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:58.795295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:58.796449 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:58.801723 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=100 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:58.808778 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:58.809226 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] PATH_INFO: `/v3/users/ef7f53d57f3544e5a25e1beeddab9af4` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:58.810743 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7f53d57f3544e5a25e1beeddab9af4)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:58.812761 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:58.845987 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1fdca-7868-46c6-87dc-2c8dd417e392 service neutron] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:58.854797 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:58.855445 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:58.855730 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:58.856032 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:58.859059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:58.872399 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:58.875211 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:58.882323 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7f53d57f3544e5a25e1beeddab9af4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:58.890198 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1451/2913] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:28:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:28:58.890978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:58.904744 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7f53d57f3544e5a25e1beeddab9af4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:58.905663 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7f53d57f3544e5a25e1beeddab9af4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:58.914606 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7f53d57f3544e5a25e1beeddab9af4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:58.915369 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7f53d57f3544e5a25e1beeddab9af4'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:58.932509 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1463/2914] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:58 2022] DELETE /identity/v3/users/ef7f53d57f3544e5a25e1beeddab9af4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:28:59.114622 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:59.129992 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f73596-ce12-49fd-aca9-c951c74cc257 service placement] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:59.192452 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:59.193086 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:59.193388 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:59.193667 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] PATH_INFO: `/v3/projects/fd2d4ae1c228446eb5bfc64d44348fdf` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:59.194865 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2d4ae1c228446eb5bfc64d44348fdf)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:59.196754 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:59.249954 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'request_id': 'req-9cc1c4ea-1205-41ee-86be-3247689c9aee'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.259118 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'request_id': 'req-9cc1c4ea-1205-41ee-86be-3247689c9aee'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.267525 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2d4ae1c228446eb5bfc64d44348fdf', 'request_id': 'req-9cc1c4ea-1205-41ee-86be-3247689c9aee'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.279227 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] The token cache is being invalidate because project fd2d4ae1c228446eb5bfc64d44348fdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:59.279582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.280367 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.282077 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1452/2915] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:59 2022] DELETE /identity/v3/projects/fd2d4ae1c228446eb5bfc64d44348fdf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:59.286374 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:59.287846 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:59.301980 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2d4fd-689e-4d03-971e-9acdf089ec22 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:59.363327 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:59.363893 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:59.364169 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:59.364439 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] PATH_INFO: `/v3/users/6b54cd14640e4901832ae64528003e77` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:59.365628 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b54cd14640e4901832ae64528003e77)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:59.367567 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:59.416932 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b54cd14640e4901832ae64528003e77'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.429833 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b54cd14640e4901832ae64528003e77'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.430564 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b54cd14640e4901832ae64528003e77'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.439396 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b54cd14640e4901832ae64528003e77'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.440171 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b54cd14640e4901832ae64528003e77'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.455549 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1464/2916] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:28:59 2022] DELETE /identity/v3/users/6b54cd14640e4901832ae64528003e77 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:28:59.646940 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:28:59.648464 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:28:59.662142 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc1c4ea-1205-41ee-86be-3247689c9aee admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:28:59.724148 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:28:59.724720 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:28:59.725005 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:28:59.725270 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] PATH_INFO: `/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:28:59.726440 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb812d2de6d4b0eb01f96c8e6854898)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:28:59.728498 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:28:59.733942 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:28:59.784985 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb812d2de6d4b0eb01f96c8e6854898', 'request_id': 'req-b31c07c8-059c-4fad-bb19-95523f5cf629'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.796120 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb812d2de6d4b0eb01f96c8e6854898', 'request_id': 'req-b31c07c8-059c-4fad-bb19-95523f5cf629'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.805292 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb812d2de6d4b0eb01f96c8e6854898', 'request_id': 'req-b31c07c8-059c-4fad-bb19-95523f5cf629'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.818719 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] The token cache is being invalidate because project dbb812d2de6d4b0eb01f96c8e6854898 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:28:59.819010 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.819881 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-b31c07c8-059c-4fad-bb19-95523f5cf629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:28:59.822007 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1453/2917] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:28:59 2022] DELETE /identity/v3/projects/dbb812d2de6d4b0eb01f96c8e6854898 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:04.075731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:04.077275 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:04.148344 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:04.169903 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc2bb2-c34b-43e3-9c6c-19fb71722ca9 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:04.232699 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a86ad86f6b9d40b0be18eb23c4e8c08b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:04.233313 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:04.233624 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:04.233917 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:04.235765 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:04.248140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:04.249781 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:04.260696 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1465/2918] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:29:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:29:05.511064 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9e9-0698-485e-a5ee-05c53c392cef None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:05.511606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9e9-0698-485e-a5ee-05c53c392cef None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:05.511729 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfe9e9-0698-485e-a5ee-05c53c392cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:05.533474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-47bfe9e9-0698-485e-a5ee-05c53c392cef None None] MFA Rules not processed for user `6fab0689ace84088890202583f75dc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:05.534763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-47bfe9e9-0698-485e-a5ee-05c53c392cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:05.600395 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1454/2919] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:10.240002 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:10.241780 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:10.316489 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960967d-3d03-4ea9-a29c-5f0b393c265f service placement] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:10.321345 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:10.322029 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:10.322304 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:10.322571 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] PATH_INFO: `/v3/users/725df7854daa42408c0336db06db57b6` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:10.323703 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725df7854daa42408c0336db06db57b6)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:10.326930 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:10.384965 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725df7854daa42408c0336db06db57b6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:10.397807 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725df7854daa42408c0336db06db57b6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:10.398707 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725df7854daa42408c0336db06db57b6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:10.411555 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725df7854daa42408c0336db06db57b6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:10.412194 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725df7854daa42408c0336db06db57b6'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:10.425505 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1466/2920] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:29:10 2022] DELETE /identity/v3/users/725df7854daa42408c0336db06db57b6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:10.430210 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:10.430869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:10.430869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:10.452460 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:10.453731 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:10.521503 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1455/2921] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 27 02:29:10.531295 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:10.533078 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:10.539288 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:10.624298 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966fed0-6447-44a0-9334-359314656535 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:10.628212 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:10.628801 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:10.629098 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:10.629370 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:10.639204 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:10.641021 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f829ba9-d947-4c37-b207-41ad05c26bb3 service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:10.651248 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1467/2922] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:29:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:29:10.967813 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:10.969545 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:10.981763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ffb2-856a-4a07-9999-211fd409533a None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:10.986363 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:10.987059 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:10.987355 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:10.987606 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] PATH_INFO: `/v3/projects/ede33742f949492bbfc5a3aa3072d54a` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:10.988752 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede33742f949492bbfc5a3aa3072d54a)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:10.990686 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:11.035614 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:11.050605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede33742f949492bbfc5a3aa3072d54a', 'request_id': 'req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:11.060055 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede33742f949492bbfc5a3aa3072d54a', 'request_id': 'req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:11.067299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede33742f949492bbfc5a3aa3072d54a', 'request_id': 'req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:11.079003 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] The token cache is being invalidate because project ede33742f949492bbfc5a3aa3072d54a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:29:11.079338 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:11.080083 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:11.081679 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1456/2923] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:29:10 2022] DELETE /identity/v3/projects/ede33742f949492bbfc5a3aa3072d54a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:20.646488 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=33 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:21.075345 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:21.521731 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686944-ec27-4e04-9e2b-8bb4c44ce51d None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:21.522219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686944-ec27-4e04-9e2b-8bb4c44ce51d None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:21.522728 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d686944-ec27-4e04-9e2b-8bb4c44ce51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:21.556656 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-3d686944-ec27-4e04-9e2b-8bb4c44ce51d None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:21.557891 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-3d686944-ec27-4e04-9e2b-8bb4c44ce51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:21.615962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1468/2924] 10.222.0.61 () {58 vars in 1009 bytes} [Sat Aug 27 02:29:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:21.670307 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:21.671934 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:21.750880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe0836-6aa7-49e6-a7a9-8eb6b8a730f8 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:21.756540 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:21.757169 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:21.757474 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:21.757748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:21.767154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:21.768763 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:21.780567 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1457/2925] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:29:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:31.609082 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=29 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:31.775229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=32 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:38.439035 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:38.439616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:38.439616 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:38.460050 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] MFA Rules not processed for user `95fe53e9d4d34a4e9c2d3dcee43c1f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:38.461300 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:38.469387 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1469/2926] 10.222.0.61 () {58 vars in 967 bytes} [Sat Aug 27 02:29:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:38.482080 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:38.493930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60fb3d-0436-4ea5-9cdd-4e179bbe7201 service swift] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:38.500393 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e7b457718554fac8c6e8fefea700674', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:38.501016 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:38.501299 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:38.501605 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:38.510845 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:38.512491 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:38.522372 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1458/2927] 10.222.0.61 () {60 vars in 1384 bytes} [Sat Aug 27 02:29:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 27 02:29:40.493955 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:40.496004 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:40.573470 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bffc06-74ac-4348-b372-2fed5a23b68a None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:40.579213 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:40.579978 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:40.580597 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:40.580902 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] PATH_INFO: `/v3/users/6fab0689ace84088890202583f75dc3e` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:40.582207 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fab0689ace84088890202583f75dc3e)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:40.584181 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:40.634581 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fab0689ace84088890202583f75dc3e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:40.647588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fab0689ace84088890202583f75dc3e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:40.648388 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fab0689ace84088890202583f75dc3e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:40.658508 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fab0689ace84088890202583f75dc3e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:40.659144 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-907bd806-d1a4-4420-845e-35dbeb752552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fab0689ace84088890202583f75dc3e'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:40.674131 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1470/2928] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:29:40 2022] DELETE /identity/v3/users/6fab0689ace84088890202583f75dc3e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:40.865821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:40.877352 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce391358-045c-430a-b66b-d456c91c41b5 service swift] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:40.947373 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:40.947984 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:40.948253 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:40.948626 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] PATH_INFO: `/v3/projects/48950f3d194a467e81bc74adfca6d94f` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:40.949747 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48950f3d194a467e81bc74adfca6d94f)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:40.951666 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:40.998651 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48950f3d194a467e81bc74adfca6d94f', 'request_id': 'req-31a1b8a3-af66-456d-b612-30307ef4a5c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.007742 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48950f3d194a467e81bc74adfca6d94f', 'request_id': 'req-31a1b8a3-af66-456d-b612-30307ef4a5c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.015582 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48950f3d194a467e81bc74adfca6d94f', 'request_id': 'req-31a1b8a3-af66-456d-b612-30307ef4a5c8'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.027891 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] The token cache is being invalidate because project 48950f3d194a467e81bc74adfca6d94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:29:41.028199 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.028920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-31a1b8a3-af66-456d-b612-30307ef4a5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.030781 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1459/2929] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:29:40 2022] DELETE /identity/v3/projects/48950f3d194a467e81bc74adfca6d94f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:29:41.037243 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.037565 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.037840 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.057862 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:41.059083 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:41.122751 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1471/2930] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:41.131616 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.131935 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.132204 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.154229 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:41.155427 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:41.163930 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1460/2931] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:41.168484 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.178279 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31dba3-6325-40f0-8b15-b15e7767c007 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.183091 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.183689 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.183962 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.184234 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.184870 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81748) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 27 02:29:41.185196 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.186925 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.198773 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:41.202730 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1472/2932] 10.222.0.61 () {58 vars in 1153 bytes} [Sat Aug 27 02:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 27 02:29:41.209266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.224303 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a455f84-1a72-4499-a4eb-71936474ff70 None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.230504 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.231108 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.231387 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.231654 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.232302 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.234266 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.265748 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1461/2933] 10.222.0.61 () {60 vars in 1153 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 27 02:29:41.270312 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.280910 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fba36-a8d3-467f-b799-496e121840d3 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.346140 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.346758 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.347040 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.347306 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.348007 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.350311 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.373495 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1473/2934] 10.222.0.61 () {60 vars in 1144 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 27 02:29:41.377825 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.389978 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9b1f-e129-4a72-9f76-68ea0790fd1d admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.395972 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.396601 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.396880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.397154 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.397869 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.399655 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.411128 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1462/2935] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:29:41.415540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.426553 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7cbcee-7d0e-4a29-9797-1f20bdb713a8 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.432219 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.432832 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.433076 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.433368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.434049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.435649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b51e75-5a9c-4615-a37d-05d73060e316 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.447766 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1474/2936] 10.222.0.61 () {58 vars in 1122 bytes} [Sat Aug 27 02:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 27 02:29:41.452300 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.463342 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31526d43-1c80-4c9c-adee-4c7757eb3841 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.468274 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.468933 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.469237 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.469561 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] PATH_INFO: `/v3/projects/545b0b0ba9eb4ed0987b9f6440b38bea/users/e31ac0d2f08e4f9bba028cf0aafe9cb2/roles/0fb732effc6f492c9a998d105764e845` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.487070 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545b0b0ba9eb4ed0987b9f6440b38bea, user_id=e31ac0d2f08e4f9bba028cf0aafe9cb2, role_id=0fb732effc6f492c9a998d105764e845)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.489789 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.504927 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1463/2937] 10.222.0.61 () {60 vars in 1483 bytes} [Sat Aug 27 02:29:41 2022] PUT /identity/v3/projects/545b0b0ba9eb4ed0987b9f6440b38bea/users/e31ac0d2f08e4f9bba028cf0aafe9cb2/roles/0fb732effc6f492c9a998d105764e845 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 27 02:29:41.516667 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] REQUEST_METHOD: `POST` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.517208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.517208 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.548845 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.auth.core [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] MFA Rules not processed for user `e31ac0d2f08e4f9bba028cf0aafe9cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81748) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:41.550109 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:41.620650 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1475/2938] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:41.632369 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.634591 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:41.654898 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:41.724487 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22efba7d-18bc-4d4f-bddf-d49a60a545f4 admin admin] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.729385 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24b6f745fb3e4451b182536941eb21d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.730071 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] REQUEST_METHOD: `GET` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.730358 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.730758 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.741458 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.742768 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f0073-655d-4381-9b49-040f733d7e4e service cinder] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.753647 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1464/2939] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:29:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:29:41.781141 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:41.848533 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75498d0-b1b5-4e3f-a532-41bb561da002 None None] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:41.854343 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:41.855049 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.855368 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.855688 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] PATH_INFO: `/v3/users/e31ac0d2f08e4f9bba028cf0aafe9cb2` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.856959 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e31ac0d2f08e4f9bba028cf0aafe9cb2)` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:41.859274 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:41.872065 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:41.914111 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e31ac0d2f08e4f9bba028cf0aafe9cb2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.926055 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e31ac0d2f08e4f9bba028cf0aafe9cb2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.926770 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e31ac0d2f08e4f9bba028cf0aafe9cb2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.934588 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e31ac0d2f08e4f9bba028cf0aafe9cb2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.935187 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.notifications [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e31ac0d2f08e4f9bba028cf0aafe9cb2'} {{(pid=81748) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:41.947551 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1476/2940] 10.222.0.61 () {58 vars in 1224 bytes} [Sat Aug 27 02:29:41 2022] DELETE /identity/v3/users/e31ac0d2f08e4f9bba028cf0aafe9cb2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:41.952247 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] REQUEST_METHOD: `POST` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:41.952759 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:41.952870 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:41.972880 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.auth.core [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] MFA Rules not processed for user `b214a184834a4cb0b49321b412607103`. Rule list: `[]` (Enabled: `True`). {{(pid=81747) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 27 02:29:41.974115 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:42.032366 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1465/2941] 10.222.0.61 () {58 vars in 958 bytes} [Sat Aug 27 02:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 27 02:29:42.042540 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Authenticating user token {{(pid=81748) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:42.044130 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.fernet_utils [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81748) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:42.102797 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5be6-2a9e-4743-996d-91d9075d6624 admin admin] Validating token access rules against request {{(pid=81748) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:42.106649 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5340cd7471884cc2b5a584d7e435d447', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb0eac5d7e6d4e069fda9ac4cb8c2c98', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81748) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:42.107266 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] REQUEST_METHOD: `GET` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:42.107541 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:42.107787 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81748) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:42.117820 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:42.119302 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4acc1f-1791-4041-b4a4-5de2bc7cdd0e service neutron] RBAC: Authorization granted {{(pid=81748) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:42.129745 dv-cinder-846303-3-smb devstack@keystone.service[81748]: [pid: 81748|app: 0|req: 1477/2942] 10.222.0.61 () {60 vars in 1365 bytes} [Sat Aug 27 02:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 27 02:29:42.417426 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] Authenticating user token {{(pid=81747) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 27 02:29:42.418952 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.fernet_utils [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81747) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 27 02:29:42.431860 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd08fc7-157a-4835-a176-89d707f4fb9c None None] Validating token access rules against request {{(pid=81747) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 27 02:29:42.437995 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b214a184834a4cb0b49321b412607103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6316912820d4459d94f37567f9470b42', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81747) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 27 02:29:42.438668 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 27 02:29:42.438920 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 27 02:29:42.439191 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] PATH_INFO: `/v3/projects/545b0b0ba9eb4ed0987b9f6440b38bea` {{(pid=81747) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 27 02:29:42.440417 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=545b0b0ba9eb4ed0987b9f6440b38bea)` {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 27 02:29:42.442451 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] RBAC: Authorization granted {{(pid=81747) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 27 02:29:42.494701 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545b0b0ba9eb4ed0987b9f6440b38bea', 'request_id': 'req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:42.503151 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545b0b0ba9eb4ed0987b9f6440b38bea', 'request_id': 'req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:42.509635 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545b0b0ba9eb4ed0987b9f6440b38bea', 'request_id': 'req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d'} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:42.520535 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] The token cache is being invalidate because project 545b0b0ba9eb4ed0987b9f6440b38bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81747) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 27 02:29:42.520821 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:42.521506 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG keystone.notifications [None req-fbf0ede5-d943-4d9c-91f0-6c00dcabe96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81747) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 27 02:29:42.523031 dv-cinder-846303-3-smb devstack@keystone.service[81747]: [pid: 81747|app: 0|req: 1466/2943] 10.222.0.61 () {58 vars in 1233 bytes} [Sat Aug 27 02:29:42 2022] DELETE /identity/v3/projects/545b0b0ba9eb4ed0987b9f6440b38bea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 27 02:29:52.124814 dv-cinder-846303-3-smb devstack@keystone.service[81748]: DEBUG dbcounter [-] [81748] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=81748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 27 02:29:52.517512 dv-cinder-846303-3-smb devstack@keystone.service[81747]: DEBUG dbcounter [-] [81747] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}